[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:19 dist-test-slave-gmjp krb5kdc[20627](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:19 dist-test-slave-gmjp krb5kdc[20627](info): set up 2 sockets
Aug 05 22:53:19 dist-test-slave-gmjp krb5kdc[20627](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260805 22:53:20.995461 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:53:21 dist-test-slave-gmjp krb5kdc[20627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:53:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:53:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:53:21.236527 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:36067
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:36067
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:21.594210 20653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:21.594524 20653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:21.594691 20653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:21.602375 20653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:53:21.602523 20653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:21.602635 20653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:21.602734 20653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:53:21.602809 20653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:53:21.613138 20653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:36067
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:36067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:21.614594 20653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:21.616138 20653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:21.629455 20659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:21.629504 20662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:21.629535 20660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:21.630489 20653 server_base.cc:1034] running on GCE node
I20260805 22:53:21.631346 20653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:21.633028 20653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:21.634284 20653 hybrid_clock.cc:648] HybridClock initialized: now 1785970401634258 us; error 90 us; skew 500 ppm
I20260805 22:53:21.634668 20653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:21 dist-test-slave-gmjp krb5kdc[20627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970401, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:21.643000 20653 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:53:21.644968 20653 webserver.cc:460] Webserver started at http://127.20.34.126:34131/ using document root <none> and password file <none>
I20260805 22:53:21.645792 20653 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:21.645949 20653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:21.646289 20653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:21.650959 20653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7"
format_stamp: "Formatted at 2026-08-05 22:53:21 on dist-test-slave-gmjp"
server_key: "004651cb0f82eff2544c096ea3ce44fd"
server_key_iv: "80898cc02d216e0b2bd17c555b94a1fc"
server_key_version: "encryptionkey@0"
I20260805 22:53:21.651811 20653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7"
format_stamp: "Formatted at 2026-08-05 22:53:21 on dist-test-slave-gmjp"
server_key: "004651cb0f82eff2544c096ea3ce44fd"
server_key_iv: "80898cc02d216e0b2bd17c555b94a1fc"
server_key_version: "encryptionkey@0"
I20260805 22:53:21.657609 20653 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:53:21.661466 20672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:21.662951 20653 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:53:21.663165 20653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7"
format_stamp: "Formatted at 2026-08-05 22:53:21 on dist-test-slave-gmjp"
server_key: "004651cb0f82eff2544c096ea3ce44fd"
server_key_iv: "80898cc02d216e0b2bd17c555b94a1fc"
server_key_version: "encryptionkey@0"
I20260805 22:53:21.663414 20653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:21.692286 20653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:21.697083 20653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:21.697428 20653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:21.718461 20653 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:36067
I20260805 22:53:21.718461 20757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:36067 every 8 connection(s)
I20260805 22:53:21.720356 20653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:53:21.724884 20758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:21.731344 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 20653
I20260805 22:53:21.731737 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:53:21.734555 20617 external_mini_cluster.cc:1428] Setting key 2a6c7be125a8c5d87e66234489e46ed7
I20260805 22:53:21.738567 20758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7: Bootstrap starting.
I20260805 22:53:21.742833 20758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:21.744000 20758 log.cc:824] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:21.747076 20758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7: No bootstrap required, opened a new log
I20260805 22:53:21.757257 20758 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36067 } }
I20260805 22:53:21.757824 20758 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:21.757952 20758 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e7ba162c7ab409fa70aeacb8ca10ef7, State: Initialized, Role: FOLLOWER
I20260805 22:53:21.758716 20758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36067 } }
I20260805 22:53:21.759021 20758 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:53:21.759198 20758 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:53:21.759419 20758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:21.762313 20758 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36067 } }
I20260805 22:53:21.763013 20758 leader_election.cc:302] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e7ba162c7ab409fa70aeacb8ca10ef7; no voters:
I20260805 22:53:21.763671 20758 leader_election.cc:288] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:53:21.763907 20765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:21.765133 20765 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [term 1 LEADER]: Becoming Leader. State: Replica: 6e7ba162c7ab409fa70aeacb8ca10ef7, State: Running, Role: LEADER
I20260805 22:53:21.765829 20765 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36067 } }
I20260805 22:53:21.766179 20758 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [sys.catalog]: configured and running, proceeding with master startup.
Aug 05 22:53:21 dist-test-slave-gmjp krb5kdc[20627](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:21.770126 20768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36067 } } }
I20260805 22:53:21.770942 20768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:21.769932 20769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e7ba162c7ab409fa70aeacb8ca10ef7. Latest consensus state: current_term: 1 leader_uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ba162c7ab409fa70aeacb8ca10ef7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36067 } } }
I20260805 22:53:21.771512 20769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:21.774928 20775 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:53:21.781011 20775 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:53:21.788905 20761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:21.740111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44388 (local address 127.20.34.126:36067)
0805 22:53:21.741274 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:21.741292 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:21.742771 (+ 1479us) server_negotiation.cc:407] Connection header received
0805 22:53:21.752446 (+ 9675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:21.752479 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:21.753102 (+ 623us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:21.753641 (+ 539us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:21.757092 (+ 3451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:21.759198 (+ 2106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:21.761180 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:21.762286 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:21.762522 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:21.771416 (+ 8894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:21.771431 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:21.771456 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:21.771524 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:21.777128 (+ 5604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:21.778838 (+ 1710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:21.778855 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:21.778868 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:21.779199 (+ 331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:21.780022 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:21.780030 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:21.780036 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:21.781243 (+ 1207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:21.781691 (+ 448us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:21.785805 (+ 4114us) server_negotiation.cc:299] Negotiation successful
0805 22:53:21.786525 (+ 720us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":825,"thread_start_us":523,"threads_started":1}
I20260805 22:53:21.796433 20775 catalog_manager.cc:1347] Generated new cluster ID: 02ebc09f1a374bd88aa20abf239fbceb
I20260805 22:53:21.796705 20775 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:53:21.823947 20775 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:53:21.826092 20775 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:53:21.834827 20775 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e7ba162c7ab409fa70aeacb8ca10ef7: Generated new TSK 0
I20260805 22:53:21.835994 20775 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:53:21.899863 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36067
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:22.264122 20803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:22.264549 20803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:22.264714 20803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:22.272863 20803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:22.273032 20803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:22.273212 20803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:53:22.283886 20803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36067
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:22.285490 20803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:22.286962 20803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:22.302034 20813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:22.302044 20811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:22.302412 20815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:22.303268 20803 server_base.cc:1034] running on GCE node
I20260805 22:53:22.304104 20803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:22.305264 20803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:22.306540 20803 hybrid_clock.cc:648] HybridClock initialized: now 1785970402306465 us; error 65 us; skew 500 ppm
I20260805 22:53:22.306911 20803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:22 dist-test-slave-gmjp krb5kdc[20627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970402, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:22.310498 20803 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:53:22.312234 20803 webserver.cc:460] Webserver started at http://127.20.34.65:44719/ using document root <none> and password file <none>
I20260805 22:53:22.313054 20803 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:22.313215 20803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:22.313571 20803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:22.316884 20803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "2c256f9174174d0db8786596b82591f9"
format_stamp: "Formatted at 2026-08-05 22:53:22 on dist-test-slave-gmjp"
server_key: "1bcbad542cbea1ed5844ec11d849b8c1"
server_key_iv: "5373f388d881bd8fc348e79da6c6db54"
server_key_version: "encryptionkey@0"
I20260805 22:53:22.317802 20803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "2c256f9174174d0db8786596b82591f9"
format_stamp: "Formatted at 2026-08-05 22:53:22 on dist-test-slave-gmjp"
server_key: "1bcbad542cbea1ed5844ec11d849b8c1"
server_key_iv: "5373f388d881bd8fc348e79da6c6db54"
server_key_version: "encryptionkey@0"
I20260805 22:53:22.323572 20803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:53:22.327555 20827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:22.329102 20803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:53:22.329309 20803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "2c256f9174174d0db8786596b82591f9"
format_stamp: "Formatted at 2026-08-05 22:53:22 on dist-test-slave-gmjp"
server_key: "1bcbad542cbea1ed5844ec11d849b8c1"
server_key_iv: "5373f388d881bd8fc348e79da6c6db54"
server_key_version: "encryptionkey@0"
I20260805 22:53:22.329545 20803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:22.348335 20803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:22.353302 20803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:22.353664 20803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:22.354781 20803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:22.356432 20803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:22.356536 20803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:22.356695 20803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:22.356771 20803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:22.393244 20803 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:36079
I20260805 22:53:22.393311 21002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:36079 every 8 connection(s)
I20260805 22:53:22.394650 20803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:53:22.404842 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 20803
I20260805 22:53:22.405113 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:53:22.405793 20617 external_mini_cluster.cc:1428] Setting key 31e1877e06948bc7726ec63bf26392eb
Aug 05 22:53:22 dist-test-slave-gmjp krb5kdc[20627](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970402, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:22.418399 21007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:22.397736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:56435 (local address 127.20.34.126:36067)
0805 22:53:22.398303 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:22.398308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:22.399370 (+ 1062us) server_negotiation.cc:407] Connection header received
0805 22:53:22.401540 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:22.401547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:22.401651 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:22.401802 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:22.403525 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:22.404599 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:22.406453 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:22.407075 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:22.407190 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:22.411341 (+ 4151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:22.411351 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:22.411359 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:22.411409 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:22.415000 (+ 3591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:22.415740 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:22.415748 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:22.415753 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:22.415928 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:22.416531 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:22.416535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:22.416537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:22.416824 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:22.416944 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:22.417925 (+ 981us) server_negotiation.cc:299] Negotiation successful
0805 22:53:22.418122 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":301,"threads_started":1}
I20260805 22:53:22.420022 21008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:22.398195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36067 (local address 127.20.34.65:56435)
0805 22:53:22.399060 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:22.399109 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:22.401219 (+ 2110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:22.402083 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:22.402091 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:22.402697 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:22.403324 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:22.403344 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:22.404802 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:22.404806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:22.406268 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:22.406281 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:22.407330 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:22.407338 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:22.407639 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:22.408532 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:22.408557 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:22.411087 (+ 2530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:22.415144 (+ 4057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:22.415151 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:22.415166 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:22.415610 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:22.416045 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:22.416052 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:22.416057 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:22.416411 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:22.416967 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:22.416978 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:22.417489 (+ 511us) client_negotiation.cc:769] Sending connection context
0805 22:53:22.417823 (+ 334us) client_negotiation.cc:240] Negotiation successful
0805 22:53:22.418473 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":351,"threads_started":1}
I20260805 22:53:22.421905 21003 heartbeater.cc:347] Connected to a master server at 127.20.34.126:36067
I20260805 22:53:22.422273 21003 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:22.423055 21003 heartbeater.cc:511] Master 127.20.34.126:36067 requested a full tablet report, sending...
I20260805 22:53:22.425486 20702 ts_manager.cc:194] Registered new tserver with Master: 2c256f9174174d0db8786596b82591f9 (127.20.34.65:36079)
I20260805 22:53:22.426997 20702 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:56435
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:53:22.460907 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36067
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:22.821870 21013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:22.822263 21013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:22.822453 21013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:22.830353 21013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:22.830538 21013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:22.830722 21013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:53:22.841454 21013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36067
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:22.843039 21013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:22.844504 21013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:22.859005 21021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:22.859040 21023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:22.859005 21020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:22.859724 21013 server_base.cc:1034] running on GCE node
I20260805 22:53:22.860549 21013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:22.861632 21013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:22.862907 21013 hybrid_clock.cc:648] HybridClock initialized: now 1785970402862859 us; error 67 us; skew 500 ppm
I20260805 22:53:22.863286 21013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:22 dist-test-slave-gmjp krb5kdc[20627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970402, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:22.869311 21013 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:53:22.871937 21013 webserver.cc:460] Webserver started at http://127.20.34.66:39181/ using document root <none> and password file <none>
I20260805 22:53:22.873085 21013 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:22.873345 21013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:22.873848 21013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:22.878257 21013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "78080990790a4ff29655c1de3f14dfbb"
format_stamp: "Formatted at 2026-08-05 22:53:22 on dist-test-slave-gmjp"
server_key: "4d120a666919942faaeda83e6dd2b8b3"
server_key_iv: "db26b37479f98231b2d14222ed4b3418"
server_key_version: "encryptionkey@0"
I20260805 22:53:22.879279 21013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "78080990790a4ff29655c1de3f14dfbb"
format_stamp: "Formatted at 2026-08-05 22:53:22 on dist-test-slave-gmjp"
server_key: "4d120a666919942faaeda83e6dd2b8b3"
server_key_iv: "db26b37479f98231b2d14222ed4b3418"
server_key_version: "encryptionkey@0"
I20260805 22:53:22.886571 21013 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260805 22:53:22.892675 21034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:22.894958 21013 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260805 22:53:22.895190 21013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "78080990790a4ff29655c1de3f14dfbb"
format_stamp: "Formatted at 2026-08-05 22:53:22 on dist-test-slave-gmjp"
server_key: "4d120a666919942faaeda83e6dd2b8b3"
server_key_iv: "db26b37479f98231b2d14222ed4b3418"
server_key_version: "encryptionkey@0"
I20260805 22:53:22.895535 21013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:22.911679 21013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:22.917860 21013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:22.918363 21013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:22.919790 21013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:22.921854 21013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:22.922020 21013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:22.922228 21013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:22.922288 21013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:22.975673 21013 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:34607
I20260805 22:53:22.975781 21203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:34607 every 8 connection(s)
I20260805 22:53:22.977182 21013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:53:22.985150 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21013
I20260805 22:53:22.985410 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:53:22.986007 20617 external_mini_cluster.cc:1428] Setting key 6738204c4333be0580c7821447f89299
Aug 05 22:53:22 dist-test-slave-gmjp krb5kdc[20627](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970402, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:23.001991 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:22.979965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:58635 (local address 127.20.34.126:36067)
0805 22:53:22.980492 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:22.980497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:22.981499 (+ 1002us) server_negotiation.cc:407] Connection header received
0805 22:53:22.983461 (+ 1962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:22.983466 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:22.983568 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:22.983695 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:22.985812 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:22.986647 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:22.988873 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:22.989613 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:22.989775 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:22.993995 (+ 4220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:22.994004 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:22.994012 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:22.994063 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:22.997976 (+ 3913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:22.999160 (+ 1184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:22.999165 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:22.999167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:22.999329 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:22.999902 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:22.999906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:22.999908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.000293 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:23.000417 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:23.001481 (+ 1064us) server_negotiation.cc:299] Negotiation successful
0805 22:53:23.001687 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":293,"threads_started":1}
I20260805 22:53:23.003682 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:22.980545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36067 (local address 127.20.34.66:58635)
0805 22:53:22.981295 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:22.981342 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:22.983170 (+ 1828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:22.983958 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:22.983966 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:22.984604 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:22.985552 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:22.985586 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:22.986841 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:22.986848 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:22.988680 (+ 1832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:22.988705 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:22.989873 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:22.989878 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:22.990093 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:22.990854 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:22.990880 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:22.993680 (+ 2800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:22.998175 (+ 4495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:22.998188 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:22.998211 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:22.998978 (+ 767us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:22.999479 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:22.999487 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:22.999494 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:22.999787 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:23.000428 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:23.000440 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:23.000984 (+ 544us) client_negotiation.cc:769] Sending connection context
0805 22:53:23.001351 (+ 367us) client_negotiation.cc:240] Negotiation successful
0805 22:53:23.002044 (+ 693us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":296,"threads_started":1}
I20260805 22:53:23.005613 21204 heartbeater.cc:347] Connected to a master server at 127.20.34.126:36067
I20260805 22:53:23.005993 21204 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:23.007089 21204 heartbeater.cc:511] Master 127.20.34.126:36067 requested a full tablet report, sending...
I20260805 22:53:23.009033 20702 ts_manager.cc:194] Registered new tserver with Master: 78080990790a4ff29655c1de3f14dfbb (127.20.34.66:34607)
I20260805 22:53:23.009918 20702 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:58635
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:53:23.044114 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36067
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:23.417707 21214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:23.418080 21214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:23.418282 21214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:23.425978 21214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:23.426172 21214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:23.426355 21214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:53:23.430431 21003 heartbeater.cc:503] Master 127.20.34.126:36067 was elected leader, sending a full tablet report...
I20260805 22:53:23.437472 21214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36067
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:23.439033 21214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:23.440584 21214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:23.455318 21224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:23.455384 21222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:23.455320 21227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:23.456231 21214 server_base.cc:1034] running on GCE node
I20260805 22:53:23.457033 21214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:23.458106 21214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:23.459329 21214 hybrid_clock.cc:648] HybridClock initialized: now 1785970403459270 us; error 44 us; skew 500 ppm
I20260805 22:53:23.459694 21214 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:23 dist-test-slave-gmjp krb5kdc[20627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970403, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:23.463212 21214 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:53:23.464888 21214 webserver.cc:460] Webserver started at http://127.20.34.67:45403/ using document root <none> and password file <none>
I20260805 22:53:23.465603 21214 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:23.465715 21214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:23.466041 21214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:23.469633 21214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "c523d39c3f1345e791b29ab1475cf469"
format_stamp: "Formatted at 2026-08-05 22:53:23 on dist-test-slave-gmjp"
server_key: "1800d5716b6d630e1aefd3254e7c5b37"
server_key_iv: "25d3d699b0332cea46841bd1c16f8ab5"
server_key_version: "encryptionkey@0"
I20260805 22:53:23.470511 21214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "c523d39c3f1345e791b29ab1475cf469"
format_stamp: "Formatted at 2026-08-05 22:53:23 on dist-test-slave-gmjp"
server_key: "1800d5716b6d630e1aefd3254e7c5b37"
server_key_iv: "25d3d699b0332cea46841bd1c16f8ab5"
server_key_version: "encryptionkey@0"
I20260805 22:53:23.476532 21214 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 22:53:23.480454 21237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:23.481925 21214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:53:23.482120 21214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "c523d39c3f1345e791b29ab1475cf469"
format_stamp: "Formatted at 2026-08-05 22:53:23 on dist-test-slave-gmjp"
server_key: "1800d5716b6d630e1aefd3254e7c5b37"
server_key_iv: "25d3d699b0332cea46841bd1c16f8ab5"
server_key_version: "encryptionkey@0"
I20260805 22:53:23.482362 21214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:23.500957 21214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:23.505678 21214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:23.506016 21214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:23.507154 21214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:23.508698 21214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:23.508821 21214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:23.508980 21214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:23.509079 21214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:23.544737 21214 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:42567
I20260805 22:53:23.544786 21404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:42567 every 8 connection(s)
I20260805 22:53:23.546109 21214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:53:23.550491 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21214
I20260805 22:53:23.550704 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:53:23.551163 20617 external_mini_cluster.cc:1428] Setting key 322aff5b4147492430c5f90f6456711d
Aug 05 22:53:23 dist-test-slave-gmjp krb5kdc[20627](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970403, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:23.567732 21408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:23.548786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:38023 (local address 127.20.34.126:36067)
0805 22:53:23.549280 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:23.549285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:23.550214 (+ 929us) server_negotiation.cc:407] Connection header received
0805 22:53:23.552419 (+ 2205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:23.552424 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:23.552545 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:23.552667 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:23.554496 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.555538 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.557196 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.557591 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.557687 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:23.561181 (+ 3494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:23.561186 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:23.561190 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:23.561224 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:23.563829 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.564696 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.564700 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.564703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.564832 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.565251 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.565254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.565256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.565572 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:23.565706 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:23.566887 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0805 22:53:23.567156 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":253,"threads_started":1}
I20260805 22:53:23.568877 21410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:23.549239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36067 (local address 127.20.34.67:38023)
0805 22:53:23.550008 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:23.550060 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:23.552032 (+ 1972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:23.553002 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:23.553011 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:23.553585 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:23.554321 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:23.554342 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.555682 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.555686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:23.557057 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:23.557071 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.557794 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.557799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:23.558006 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:23.558671 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:23.558701 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:23.560975 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:23.563981 (+ 3006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:23.563990 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:23.564005 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:23.564566 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:23.564933 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:23.564937 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:23.564939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:23.565149 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:23.565743 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:23.565753 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:23.566300 (+ 547us) client_negotiation.cc:769] Sending connection context
0805 22:53:23.566685 (+ 385us) client_negotiation.cc:240] Negotiation successful
0805 22:53:23.567338 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":314,"threads_started":1}
I20260805 22:53:23.570287 21405 heartbeater.cc:347] Connected to a master server at 127.20.34.126:36067
I20260805 22:53:23.570634 21405 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:23.571486 21405 heartbeater.cc:511] Master 127.20.34.126:36067 requested a full tablet report, sending...
I20260805 22:53:23.573122 20702 ts_manager.cc:194] Registered new tserver with Master: c523d39c3f1345e791b29ab1475cf469 (127.20.34.67:42567)
I20260805 22:53:23.573982 20702 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:38023
I20260805 22:53:23.581034 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:53:23 dist-test-slave-gmjp krb5kdc[20627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970403, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:53:23 dist-test-slave-gmjp krb5kdc[20627](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970403, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:23.639595 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:23.622400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34954 (local address 127.20.34.65:36079)
0805 22:53:23.623146 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:23.623153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:23.623183 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:53:23.623357 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:23.623364 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:23.623595 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:23.623730 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:23.625388 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.626512 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.628065 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.628755 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.628874 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:23.633234 (+ 4360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:23.633251 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:23.633269 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:23.633313 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:23.636475 (+ 3162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.637282 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.637291 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.637294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.637455 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.637852 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.637856 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.637858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.638288 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:23.638570 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:23.638884 (+ 314us) server_negotiation.cc:299] Negotiation successful
0805 22:53:23.639161 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":399,"threads_started":1}
W20260805 22:53:23.641191 20868 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34954
Aug 05 22:53:23 dist-test-slave-gmjp krb5kdc[20627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:53:23 dist-test-slave-gmjp krb5kdc[20627](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:23.696198 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:23.681285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.20.34.65:36079)
0805 22:53:23.681547 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:23.681555 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:23.681880 (+ 325us) server_negotiation.cc:407] Connection header received
0805 22:53:23.682107 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:23.682111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:23.682180 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:23.682290 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:23.683688 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.684467 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.685709 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.686218 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.686368 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:23.690571 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:23.690576 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:23.690580 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:23.690616 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:23.693434 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.694114 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.694121 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.694125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.694264 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.694649 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.694655 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.694658 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.694968 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:23.695237 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:23.695566 (+ 329us) server_negotiation.cc:299] Negotiation successful
0805 22:53:23.695798 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260805 22:53:23.697948 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20803
I20260805 22:53:23.711826 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:23.698969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34986 (local address 127.20.34.65:36079)
0805 22:53:23.699160 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:23.699169 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:23.699555 (+ 386us) server_negotiation.cc:407] Connection header received
0805 22:53:23.699798 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:23.699803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:23.699864 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:23.699944 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:23.701259 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.702005 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.703304 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.703739 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.703851 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:23.706325 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:23.706330 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:23.706334 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:23.706370 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:23.709160 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.709849 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.709853 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.709855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.710071 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.710468 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.710471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.710474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.710781 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:23.710989 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:23.711265 (+ 276us) server_negotiation.cc:299] Negotiation successful
0805 22:53:23.711436 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 22:53:23.712728 20994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:23.799959 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 20803
I20260805 22:53:23.826948 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21013
Aug 05 22:53:23 dist-test-slave-gmjp krb5kdc[20627](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:53:23.844868 21424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:23.828098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41496 (local address 127.20.34.66:34607)
0805 22:53:23.828716 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:23.828724 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:23.828752 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:53:23.828824 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:23.828831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:23.829058 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:23.829258 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:23.830566 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.831602 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.833047 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.833655 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.833814 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:23.838127 (+ 4313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:23.838142 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:23.838159 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:23.838201 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:23.841531 (+ 3330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.842235 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.842244 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.842247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.842380 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.842871 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.842875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.842878 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.843255 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:23.843525 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:23.843923 (+ 398us) server_negotiation.cc:299] Negotiation successful
0805 22:53:23.844531 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":318,"threads_started":1}
I20260805 22:53:23.846426 21197 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:23.933275 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21013
I20260805 22:53:23.958124 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21214
Aug 05 22:53:23 dist-test-slave-gmjp krb5kdc[20627](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:53:23.976073 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:23.959285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34124 (local address 127.20.34.67:42567)
0805 22:53:23.959969 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:23.959976 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:23.960007 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:53:23.960074 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:23.960081 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:23.960377 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:23.960518 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:23.961902 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.963003 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.964486 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:23.965064 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:23.965166 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:23.969742 (+ 4576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:23.969759 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:23.969794 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:23.969837 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:23.973132 (+ 3295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.973883 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.973890 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.973892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.974023 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:23.974389 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:23.974392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:23.974394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:23.974787 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:23.975085 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:23.975393 (+ 308us) server_negotiation.cc:299] Negotiation successful
0805 22:53:23.975611 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":333,"threads_started":1}
I20260805 22:53:23.977516 21400 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:24.062198 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21214
I20260805 22:53:24.087188 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20653
I20260805 22:53:24.088551 20751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:24.202649 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 20653
2026-08-05T22:53:24Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4548 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:24 dist-test-slave-gmjp krb5kdc[21432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:24 dist-test-slave-gmjp krb5kdc[21432](info): set up 2 sockets
Aug 05 22:53:24 dist-test-slave-gmjp krb5kdc[21432](info): commencing operation
krb5kdc: starting...
W20260805 22:53:25.507153 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.001s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:53:25 dist-test-slave-gmjp krb5kdc[21432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:53:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:53:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:53:25.760628 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:35233
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:35233
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:26.112015 21447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:26.112424 21447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:26.112528 21447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:26.120325 21447 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:53:26.120464 21447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:26.120512 21447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:26.120571 21447 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:53:26.120616 21447 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:53:26.130952 21447 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:35233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:35233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:26.132354 21447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:26.133656 21447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:26.146114 21457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:26.146133 21462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:26.146292 21459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:26.147439 21447 server_base.cc:1034] running on GCE node
I20260805 22:53:26.148391 21447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:26.149932 21447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:26.151196 21447 hybrid_clock.cc:648] HybridClock initialized: now 1785970406151125 us; error 44 us; skew 500 ppm
I20260805 22:53:26.151600 21447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:26 dist-test-slave-gmjp krb5kdc[21432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970406, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:26.155005 21447 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:53:26.156690 21447 webserver.cc:460] Webserver started at http://127.20.34.126:37651/ using document root <none> and password file <none>
I20260805 22:53:26.157420 21447 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:26.157584 21447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:26.157933 21447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:26.161237 21447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "4aeee03b71e849b883135f08e8a7f456"
format_stamp: "Formatted at 2026-08-05 22:53:26 on dist-test-slave-gmjp"
server_key: "d9532b59da360cb7d3dd6778a8899887"
server_key_iv: "ff3ed6fc6e647a12f8a0b5ee7f7d3883"
server_key_version: "encryptionkey@0"
I20260805 22:53:26.162029 21447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "4aeee03b71e849b883135f08e8a7f456"
format_stamp: "Formatted at 2026-08-05 22:53:26 on dist-test-slave-gmjp"
server_key: "d9532b59da360cb7d3dd6778a8899887"
server_key_iv: "ff3ed6fc6e647a12f8a0b5ee7f7d3883"
server_key_version: "encryptionkey@0"
I20260805 22:53:26.167929 21447 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260805 22:53:26.171870 21471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:26.173496 21447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:53:26.173700 21447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "4aeee03b71e849b883135f08e8a7f456"
format_stamp: "Formatted at 2026-08-05 22:53:26 on dist-test-slave-gmjp"
server_key: "d9532b59da360cb7d3dd6778a8899887"
server_key_iv: "ff3ed6fc6e647a12f8a0b5ee7f7d3883"
server_key_version: "encryptionkey@0"
I20260805 22:53:26.173951 21447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:26.188882 21447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:26.193279 21447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:26.193599 21447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:26.214128 21447 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:35233
I20260805 22:53:26.214120 21549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:35233 every 8 connection(s)
I20260805 22:53:26.215689 21447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:53:26.220067 21552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:26.224702 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21447
I20260805 22:53:26.224961 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:53:26.225642 20617 external_mini_cluster.cc:1428] Setting key f3790173f01c269df9f74d5282a3b2ad
I20260805 22:53:26.231946 21552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456: Bootstrap starting.
I20260805 22:53:26.236622 21552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:26.238049 21552 log.cc:824] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:26.241492 21552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456: No bootstrap required, opened a new log
Aug 05 22:53:26 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:26.249832 21552 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aeee03b71e849b883135f08e8a7f456" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35233 } }
I20260805 22:53:26.250284 21552 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:26.250438 21552 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aeee03b71e849b883135f08e8a7f456, State: Initialized, Role: FOLLOWER
I20260805 22:53:26.251173 21552 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aeee03b71e849b883135f08e8a7f456" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35233 } }
I20260805 22:53:26.251477 21552 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:53:26.251670 21552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:53:26.251864 21556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:26.227703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60238 (local address 127.20.34.126:35233)
0805 22:53:26.228719 (+ 1016us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:26.228731 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:26.228773 (+ 42us) server_negotiation.cc:407] Connection header received
0805 22:53:26.230614 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:26.230638 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:26.231043 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:26.231362 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:26.233348 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:26.235647 (+ 2299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:26.237600 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:26.238826 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:26.239009 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:26.243677 (+ 4668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:26.243686 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:26.243702 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:26.243754 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:26.247161 (+ 3407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:26.247958 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:26.247966 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:26.247973 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:26.248221 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:26.248631 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:26.248640 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:26.248642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:26.249224 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:26.249552 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:26.250082 (+ 530us) server_negotiation.cc:299] Negotiation successful
0805 22:53:26.250592 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":564,"threads_started":1}
I20260805 22:53:26.251897 21552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:26.254932 21552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aeee03b71e849b883135f08e8a7f456" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35233 } }
I20260805 22:53:26.255511 21552 leader_election.cc:302] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aeee03b71e849b883135f08e8a7f456; no voters:
I20260805 22:53:26.256194 21552 leader_election.cc:288] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:53:26.256368 21560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:26.257149 21560 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [term 1 LEADER]: Becoming Leader. State: Replica: 4aeee03b71e849b883135f08e8a7f456, State: Running, Role: LEADER
I20260805 22:53:26.257710 21560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aeee03b71e849b883135f08e8a7f456" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35233 } }
I20260805 22:53:26.258392 21552 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:53:26.260744 21562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aeee03b71e849b883135f08e8a7f456. Latest consensus state: current_term: 1 leader_uuid: "4aeee03b71e849b883135f08e8a7f456" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aeee03b71e849b883135f08e8a7f456" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35233 } } }
I20260805 22:53:26.261133 21562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:26.261969 21561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4aeee03b71e849b883135f08e8a7f456" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aeee03b71e849b883135f08e8a7f456" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35233 } } }
I20260805 22:53:26.262369 21561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:26.263432 21565 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:53:26.269806 21565 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:53:26.280051 21565 catalog_manager.cc:1347] Generated new cluster ID: a0408a8715304c6789fbbd8b00471579
I20260805 22:53:26.280220 21565 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:53:26.298981 21565 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:53:26.300973 21565 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:53:26.310806 21565 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4aeee03b71e849b883135f08e8a7f456: Generated new TSK 0
I20260805 22:53:26.311988 21565 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:53:26.374172 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:35233
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:26.732961 21585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:26.733291 21585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:26.733395 21585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:26.741475 21585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:26.741600 21585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:26.741721 21585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:53:26.752108 21585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:35233
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:26.753684 21585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:26.755156 21585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:26.769774 21592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:26.769860 21594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:26.769820 21597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:26.770560 21585 server_base.cc:1034] running on GCE node
I20260805 22:53:26.771282 21585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:26.772346 21585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:26.773600 21585 hybrid_clock.cc:648] HybridClock initialized: now 1785970406773542 us; error 65 us; skew 500 ppm
I20260805 22:53:26.773944 21585 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:26 dist-test-slave-gmjp krb5kdc[21432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970406, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:26.781757 21585 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:53:26.783530 21585 webserver.cc:460] Webserver started at http://127.20.34.65:38313/ using document root <none> and password file <none>
I20260805 22:53:26.784416 21585 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:26.784577 21585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:26.784924 21585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:26.788146 21585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "81797e52714a416aa508b6c7be7e39c7"
format_stamp: "Formatted at 2026-08-05 22:53:26 on dist-test-slave-gmjp"
server_key: "b420bd077fbfe7ed71ab53d1f218d615"
server_key_iv: "fa7fc1721fb6e0b9c90c4b00306cb64f"
server_key_version: "encryptionkey@0"
I20260805 22:53:26.789098 21585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "81797e52714a416aa508b6c7be7e39c7"
format_stamp: "Formatted at 2026-08-05 22:53:26 on dist-test-slave-gmjp"
server_key: "b420bd077fbfe7ed71ab53d1f218d615"
server_key_iv: "fa7fc1721fb6e0b9c90c4b00306cb64f"
server_key_version: "encryptionkey@0"
I20260805 22:53:26.795027 21585 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:53:26.799084 21606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:26.800756 21585 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 22:53:26.800976 21585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "81797e52714a416aa508b6c7be7e39c7"
format_stamp: "Formatted at 2026-08-05 22:53:26 on dist-test-slave-gmjp"
server_key: "b420bd077fbfe7ed71ab53d1f218d615"
server_key_iv: "fa7fc1721fb6e0b9c90c4b00306cb64f"
server_key_version: "encryptionkey@0"
I20260805 22:53:26.801222 21585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:26.826126 21585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:26.830971 21585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:26.831310 21585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:26.832517 21585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:26.834017 21585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:26.834127 21585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:26.834285 21585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:26.834375 21585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:26.870939 21585 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:41933
I20260805 22:53:26.871037 21766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:41933 every 8 connection(s)
I20260805 22:53:26.872385 21585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:53:26.879129 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21585
I20260805 22:53:26.879415 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:53:26.880272 20617 external_mini_cluster.cc:1428] Setting key 9e0a972d5595cdc75b8179fbd832fc3f
Aug 05 22:53:26 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970406, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:26.895668 21770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:26.875240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:55337 (local address 127.20.34.126:35233)
0805 22:53:26.875729 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:26.875734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:26.876869 (+ 1135us) server_negotiation.cc:407] Connection header received
0805 22:53:26.879111 (+ 2242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:26.879117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:26.879194 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:26.879348 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:26.881500 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:26.882282 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:26.883921 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:26.884421 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:26.884576 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:26.888989 (+ 4413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:26.888996 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:26.888999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:26.889038 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:26.891846 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:26.893037 (+ 1191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:26.893042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:26.893045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:26.893184 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:26.893730 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:26.893733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:26.893735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:26.894025 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:26.894157 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:26.895199 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0805 22:53:26.895399 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":245,"threads_started":1}
I20260805 22:53:26.897437 21776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:26.875843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:35233 (local address 127.20.34.65:55337)
0805 22:53:26.876676 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:26.876736 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:26.878763 (+ 2027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:26.879662 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:26.879678 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:26.880555 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:26.881314 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:26.881333 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:26.882467 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:26.882471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:26.883755 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:26.883768 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:26.884686 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:26.884696 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:26.884966 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:26.885788 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:26.885814 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:26.888668 (+ 2854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:26.892054 (+ 3386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:26.892068 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:26.892093 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:26.892866 (+ 773us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:26.893314 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:26.893323 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:26.893330 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:26.893603 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:26.894193 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:26.894205 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:26.894742 (+ 537us) client_negotiation.cc:769] Sending connection context
0805 22:53:26.895086 (+ 344us) client_negotiation.cc:240] Negotiation successful
0805 22:53:26.895765 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":367,"threads_started":1}
I20260805 22:53:26.899238 21767 heartbeater.cc:347] Connected to a master server at 127.20.34.126:35233
I20260805 22:53:26.899582 21767 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:26.900717 21767 heartbeater.cc:511] Master 127.20.34.126:35233 requested a full tablet report, sending...
I20260805 22:53:26.903172 21495 ts_manager.cc:194] Registered new tserver with Master: 81797e52714a416aa508b6c7be7e39c7 (127.20.34.65:41933)
I20260805 22:53:26.904837 21495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:55337
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:53:26.935477 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:35233
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:27.299348 21782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:27.299677 21782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:27.299866 21782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:27.307652 21782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:27.307783 21782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:27.307982 21782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:53:27.318892 21782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:35233
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:27.320490 21782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:27.321949 21782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:27.336309 21791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:27.336280 21796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:27.336220 21798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:27.337260 21782 server_base.cc:1034] running on GCE node
I20260805 22:53:27.337944 21782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:27.339016 21782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:27.340255 21782 hybrid_clock.cc:648] HybridClock initialized: now 1785970407340207 us; error 42 us; skew 500 ppm
I20260805 22:53:27.340605 21782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:27 dist-test-slave-gmjp krb5kdc[21432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970407, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:27.343961 21782 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:53:27.345633 21782 webserver.cc:460] Webserver started at http://127.20.34.66:45593/ using document root <none> and password file <none>
I20260805 22:53:27.346344 21782 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:27.346452 21782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:27.346724 21782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:27.350057 21782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "24f357b1ca9545bdbbd7ad87fda0fed5"
format_stamp: "Formatted at 2026-08-05 22:53:27 on dist-test-slave-gmjp"
server_key: "ed8ce8fc45a9fdcb4d052b10e2b04abb"
server_key_iv: "0a70860e79f2610346c367966057a9dd"
server_key_version: "encryptionkey@0"
I20260805 22:53:27.350926 21782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "24f357b1ca9545bdbbd7ad87fda0fed5"
format_stamp: "Formatted at 2026-08-05 22:53:27 on dist-test-slave-gmjp"
server_key: "ed8ce8fc45a9fdcb4d052b10e2b04abb"
server_key_iv: "0a70860e79f2610346c367966057a9dd"
server_key_version: "encryptionkey@0"
I20260805 22:53:27.356897 21782 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 22:53:27.361143 21810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:27.363018 21782 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 22:53:27.363229 21782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "24f357b1ca9545bdbbd7ad87fda0fed5"
format_stamp: "Formatted at 2026-08-05 22:53:27 on dist-test-slave-gmjp"
server_key: "ed8ce8fc45a9fdcb4d052b10e2b04abb"
server_key_iv: "0a70860e79f2610346c367966057a9dd"
server_key_version: "encryptionkey@0"
I20260805 22:53:27.363523 21782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:27.380980 21782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:27.385759 21782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:27.386044 21782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:27.387147 21782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:27.388723 21782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:27.388804 21782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:27.388900 21782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:27.388950 21782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:27.427203 21782 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:36187
I20260805 22:53:27.427264 21973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:36187 every 8 connection(s)
I20260805 22:53:27.428798 21782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:53:27.429836 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21782
I20260805 22:53:27.430066 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:53:27.430657 20617 external_mini_cluster.cc:1428] Setting key c7a6c2d66f83d7e1672f013ac89a6091
Aug 05 22:53:27 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970407, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:27.454439 21984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:27.432111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:39795 (local address 127.20.34.126:35233)
0805 22:53:27.434822 (+ 2711us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:27.434830 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:27.434854 (+ 24us) server_negotiation.cc:407] Connection header received
0805 22:53:27.436461 (+ 1607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:27.436467 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:27.436566 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:27.436696 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:27.438414 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:27.439218 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:27.440985 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:27.441683 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:27.441846 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:27.446580 (+ 4734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:27.446587 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:27.446590 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:27.446628 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:27.449853 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:27.451130 (+ 1277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:27.451135 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:27.451137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:27.451308 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:27.451972 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:27.451976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:27.451978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:27.452375 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:27.452663 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:27.453746 (+ 1083us) server_negotiation.cc:299] Negotiation successful
0805 22:53:27.453973 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2571,"thread_start_us":2416,"threads_started":1}
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
I20260805 22:53:27.455892 21985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:27.432907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:35233 (local address 127.20.34.66:39795)
0805 22:53:27.434038 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:27.434089 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:27.436060 (+ 1971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:27.436998 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:27.437008 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:27.437592 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:27.438215 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:27.438236 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:27.439405 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:27.439415 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:27.440812 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:27.440827 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:27.441970 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:27.441977 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:27.442238 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:27.443091 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:27.443119 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:27.446240 (+ 3121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:27.450090 (+ 3850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:27.450104 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:27.450131 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:27.450920 (+ 789us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:27.451466 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:27.451474 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:27.451481 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:27.451818 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:27.452642 (+ 824us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:27.452653 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:27.453220 (+ 567us) client_negotiation.cc:769] Sending connection context
0805 22:53:27.453607 (+ 387us) client_negotiation.cc:240] Negotiation successful
0805 22:53:27.454345 (+ 738us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"thread_start_us":550,"threads_started":1}
I20260805 22:53:27.457587 21979 heartbeater.cc:347] Connected to a master server at 127.20.34.126:35233
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
I20260805 22:53:27.458019 21979 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:27.459101 21979 heartbeater.cc:511] Master 127.20.34.126:35233 requested a full tablet report, sending...
I20260805 22:53:27.461056 21495 ts_manager.cc:194] Registered new tserver with Master: 24f357b1ca9545bdbbd7ad87fda0fed5 (127.20.34.66:36187)
I20260805 22:53:27.462225 21495 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:39795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:53:27.488550 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:35233
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:27.847765 21989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:27.848100 21989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:27.848309 21989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:27.856099 21989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:27.856344 21989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:27.856590 21989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:53:27.867660 21989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:35233
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:27.869304 21989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:27.870823 21989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:27.885421 21995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:27.885454 21997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:27.885486 22000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:27.886345 21989 server_base.cc:1034] running on GCE node
I20260805 22:53:27.887084 21989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:27.888280 21989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:27.889537 21989 hybrid_clock.cc:648] HybridClock initialized: now 1785970407889482 us; error 53 us; skew 500 ppm
I20260805 22:53:27.890002 21989 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:27 dist-test-slave-gmjp krb5kdc[21432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970407, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:27.893560 21989 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:53:27.895237 21989 webserver.cc:460] Webserver started at http://127.20.34.67:44123/ using document root <none> and password file <none>
I20260805 22:53:27.895968 21989 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:27.896081 21989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:27.896461 21989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:27.899623 21989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "4621867116484c09bde6c2e7c04e74e8"
format_stamp: "Formatted at 2026-08-05 22:53:27 on dist-test-slave-gmjp"
server_key: "4667d50ff710e389db0eb8ffad1553d8"
server_key_iv: "c43d912e67ee545e4bf792aaae5a336a"
server_key_version: "encryptionkey@0"
I20260805 22:53:27.900597 21989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "4621867116484c09bde6c2e7c04e74e8"
format_stamp: "Formatted at 2026-08-05 22:53:27 on dist-test-slave-gmjp"
server_key: "4667d50ff710e389db0eb8ffad1553d8"
server_key_iv: "c43d912e67ee545e4bf792aaae5a336a"
server_key_version: "encryptionkey@0"
I20260805 22:53:27.906520 21989 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:53:27.908463 21767 heartbeater.cc:503] Master 127.20.34.126:35233 was elected leader, sending a full tablet report...
I20260805 22:53:27.911576 22011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:27.913242 21989 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 22:53:27.913452 21989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "4621867116484c09bde6c2e7c04e74e8"
format_stamp: "Formatted at 2026-08-05 22:53:27 on dist-test-slave-gmjp"
server_key: "4667d50ff710e389db0eb8ffad1553d8"
server_key_iv: "c43d912e67ee545e4bf792aaae5a336a"
server_key_version: "encryptionkey@0"
I20260805 22:53:27.913682 21989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:27.938526 21989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:27.943403 21989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:27.943737 21989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:27.945007 21989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:27.946481 21989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:27.946594 21989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:27.946753 21989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:27.946830 21989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:27.983809 21989 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:34889
I20260805 22:53:27.983912 22171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:34889 every 8 connection(s)
I20260805 22:53:27.985270 21989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:53:27.994202 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21989
I20260805 22:53:27.994432 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:53:27.994962 20617 external_mini_cluster.cc:1428] Setting key 6c4dff25dd3ac9a3f12492d5873f79f2
Aug 05 22:53:27 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970407, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:28.007232 22175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:27.988143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:44971 (local address 127.20.34.126:35233)
0805 22:53:27.988636 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:27.988641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:27.989678 (+ 1037us) server_negotiation.cc:407] Connection header received
0805 22:53:27.991626 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:27.991631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:27.991759 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:27.991881 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:27.993486 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:27.994640 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:27.996398 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:27.996809 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:27.996957 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.000725 (+ 3768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:28.000730 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:28.000733 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:28.000771 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:28.003522 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.004509 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.004514 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.004517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.004702 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.005208 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.005213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.005217 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.005586 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:28.005784 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.006573 (+ 789us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.006823 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":212,"threads_started":1}
I20260805 22:53:28.008399 22176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:27.988774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:35233 (local address 127.20.34.67:44971)
0805 22:53:27.989505 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:27.989544 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:27.991345 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:27.992131 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:27.992140 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:27.992740 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:27.993315 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:27.993332 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:27.994806 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:27.994811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:27.996227 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:27.996241 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:27.997055 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:27.997063 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:27.997318 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:27.998026 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:27.998049 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:28.000446 (+ 2397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:28.003714 (+ 3268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:28.003724 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:28.003747 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:28.004352 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:28.004829 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:28.004834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:28.004838 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:28.005072 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:28.005748 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:28.005757 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:28.006167 (+ 410us) client_negotiation.cc:769] Sending connection context
0805 22:53:28.006460 (+ 293us) client_negotiation.cc:240] Negotiation successful
0805 22:53:28.007083 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":278,"threads_started":1}
I20260805 22:53:28.010146 22173 heartbeater.cc:347] Connected to a master server at 127.20.34.126:35233
I20260805 22:53:28.010500 22173 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:28.011336 22173 heartbeater.cc:511] Master 127.20.34.126:35233 requested a full tablet report, sending...
I20260805 22:53:28.013015 21494 ts_manager.cc:194] Registered new tserver with Master: 4621867116484c09bde6c2e7c04e74e8 (127.20.34.67:34889)
I20260805 22:53:28.014066 21494 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:44971
I20260805 22:53:28.023555 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:53:28.043844 22175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.030662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60240 (local address 127.20.34.126:35233)
0805 22:53:28.030854 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.030859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.031376 (+ 517us) server_negotiation.cc:407] Connection header received
0805 22:53:28.031530 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.031535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.031610 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.031707 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:28.033367 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.034219 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.035580 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.036039 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.036174 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.038566 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:28.038571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:28.038574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:28.038611 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:28.041293 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.041976 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.041979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.041982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.042105 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.042551 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.042554 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.042556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.042879 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:28.043069 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.043436 (+ 367us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.043616 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 22:53:28.051043 21494 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60240:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:53:28.058451 21494 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:28.095800 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.072835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37924 (local address 127.20.34.65:41933)
0805 22:53:28.086683 (+ 13848us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.086699 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.086750 (+ 51us) server_negotiation.cc:407] Connection header received
0805 22:53:28.086911 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.086921 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.087276 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.087565 (+ 289us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:28.089050 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.090628 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.092717 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.094316 (+ 1599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.094484 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.094739 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.095261 (+ 522us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.095443 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13520,"thread_start_us":14949,"threads_started":1}
I20260805 22:53:28.095878 22192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.072504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:41933 (local address 127.0.0.1:37924)
0805 22:53:28.079632 (+ 7128us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:28.079679 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:28.079906 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:28.087607 (+ 7701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:28.087620 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:28.087685 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:28.088400 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.088417 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.090767 (+ 2350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.090773 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.092494 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.092511 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.094594 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.094600 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.094913 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.094999 (+ 86us) client_negotiation.cc:769] Sending connection context
0805 22:53:28.095143 (+ 144us) client_negotiation.cc:240] Negotiation successful
0805 22:53:28.095423 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6834,"mutex_wait_us":51,"thread_start_us":15142,"threads_started":1}
I20260805 22:53:28.098726 22190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.072635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:36187 (local address 127.0.0.1:55262)
0805 22:53:28.087362 (+ 14727us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:28.087389 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:28.087552 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:28.089756 (+ 2204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:28.089762 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:28.089788 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:28.090458 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.090472 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.092548 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.092553 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.095050 (+ 2497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.095062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.097697 (+ 2635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.097702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.097897 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.097938 (+ 41us) client_negotiation.cc:769] Sending connection context
0805 22:53:28.098049 (+ 111us) client_negotiation.cc:240] Negotiation successful
0805 22:53:28.098211 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14561,"mutex_wait_us":164,"thread_start_us":6686,"threads_started":1}
I20260805 22:53:28.099088 22196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.074703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34889 (local address 127.0.0.1:43694)
0805 22:53:28.088564 (+ 13861us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:28.088585 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:28.088737 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:28.089790 (+ 1053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:28.089793 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:28.089810 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:28.090368 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.090384 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.092550 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.092555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.094987 (+ 2432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.095004 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.098092 (+ 3088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.098099 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.098268 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.098297 (+ 29us) client_negotiation.cc:769] Sending connection context
0805 22:53:28.098386 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 22:53:28.098536 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13692,"mutex_wait_us":49,"thread_start_us":13728,"threads_started":1}
I20260805 22:53:28.099653 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.073250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55262 (local address 127.20.34.66:36187)
0805 22:53:28.089145 (+ 15895us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.089154 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.089181 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:53:28.089294 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.089305 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.089523 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.090121 (+ 598us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:28.090653 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.092372 (+ 1719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.095242 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.096834 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.096975 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.097177 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.099081 (+ 1904us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.099294 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15664,"thread_start_us":15489,"threads_started":1}
I20260805 22:53:28.099670 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.075471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43694 (local address 127.20.34.67:34889)
0805 22:53:28.088568 (+ 13097us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.088578 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.088870 (+ 292us) server_negotiation.cc:407] Connection header received
0805 22:53:28.088997 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.089005 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.089266 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.089491 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:28.090593 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.092363 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.095160 (+ 2797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.097166 (+ 2006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.098797 (+ 1631us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.099078 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.099147 (+ 69us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.099315 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12908,"thread_start_us":12734,"threads_started":1}
I20260805 22:53:28.100479 21679 tablet_service.cc:1467] Processing CreateTablet for tablet fa86f9f4049a489789a68d327e2202a6 (DEFAULT_TABLE table=test-table [id=479ffcc3a2c9464f8e068c7f6b085b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:28.102058 21679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa86f9f4049a489789a68d327e2202a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:28.103541 21880 tablet_service.cc:1467] Processing CreateTablet for tablet fa86f9f4049a489789a68d327e2202a6 (DEFAULT_TABLE table=test-table [id=479ffcc3a2c9464f8e068c7f6b085b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:28.105255 21880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa86f9f4049a489789a68d327e2202a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:28.105250 22079 tablet_service.cc:1467] Processing CreateTablet for tablet fa86f9f4049a489789a68d327e2202a6 (DEFAULT_TABLE table=test-table [id=479ffcc3a2c9464f8e068c7f6b085b31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:28.106832 22079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa86f9f4049a489789a68d327e2202a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:28.114707 22198 tablet_bootstrap.cc:492] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7: Bootstrap starting.
I20260805 22:53:28.118602 22198 tablet_bootstrap.cc:654] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:28.120105 22198 log.cc:824] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:28.121510 22200 tablet_bootstrap.cc:492] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5: Bootstrap starting.
I20260805 22:53:28.123668 22202 tablet_bootstrap.cc:492] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8: Bootstrap starting.
I20260805 22:53:28.126112 22200 tablet_bootstrap.cc:654] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:28.126181 22198 tablet_bootstrap.cc:492] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7: No bootstrap required, opened a new log
I20260805 22:53:28.126528 22198 ts_tablet_manager.cc:1397] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260805 22:53:28.127580 22200 log.cc:824] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:28.127671 22202 tablet_bootstrap.cc:654] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:28.129266 22202 log.cc:824] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:28.132683 22202 tablet_bootstrap.cc:492] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8: No bootstrap required, opened a new log
I20260805 22:53:28.132923 22200 tablet_bootstrap.cc:492] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5: No bootstrap required, opened a new log
I20260805 22:53:28.133008 22202 ts_tablet_manager.cc:1397] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260805 22:53:28.133217 22200 ts_tablet_manager.cc:1397] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.005s
I20260805 22:53:28.137323 22198 raft_consensus.cc:348] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.137888 22198 raft_consensus.cc:374] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:28.138010 22198 raft_consensus.cc:729] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81797e52714a416aa508b6c7be7e39c7, State: Initialized, Role: FOLLOWER
I20260805 22:53:28.138764 22198 consensus_queue.cc:260] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.141638 22198 ts_tablet_manager.cc:1428] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260805 22:53:28.142035 22202 raft_consensus.cc:348] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.142546 22202 raft_consensus.cc:374] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:28.142657 22202 raft_consensus.cc:729] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621867116484c09bde6c2e7c04e74e8, State: Initialized, Role: FOLLOWER
I20260805 22:53:28.143291 22202 consensus_queue.cc:260] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.144500 22173 heartbeater.cc:503] Master 127.20.34.126:35233 was elected leader, sending a full tablet report...
I20260805 22:53:28.144718 22200 raft_consensus.cc:348] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.145236 22202 ts_tablet_manager.cc:1428] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260805 22:53:28.145206 22200 raft_consensus.cc:374] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:28.145334 22200 raft_consensus.cc:729] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24f357b1ca9545bdbbd7ad87fda0fed5, State: Initialized, Role: FOLLOWER
I20260805 22:53:28.145974 22200 consensus_queue.cc:260] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.147255 21979 heartbeater.cc:503] Master 127.20.34.126:35233 was elected leader, sending a full tablet report...
I20260805 22:53:28.147912 22200 ts_tablet_manager.cc:1428] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260805 22:53:28.181182 21981 tablet.cc:2369] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:53:28.213727 22209 raft_consensus.cc:482] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:28.214095 22209 raft_consensus.cc:504] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.216116 22209 leader_election.cc:288] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81797e52714a416aa508b6c7be7e39c7 (127.20.34.65:41933), 4621867116484c09bde6c2e7c04e74e8 (127.20.34.67:34889)
I20260805 22:53:28.224630 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.216466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:39929 (local address 127.20.34.65:41933)
0805 22:53:28.216701 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.216710 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.218067 (+ 1357us) server_negotiation.cc:407] Connection header received
0805 22:53:28.218338 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.218344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.218437 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.218540 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:28.219447 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.220527 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.222849 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.223638 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.223833 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.223926 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.224231 (+ 305us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.224361 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:53:28.225035 22213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.217016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:41933 (local address 127.20.34.66:39929)
0805 22:53:28.217926 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:28.217944 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:28.218174 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:28.218629 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:28.218634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:28.218665 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:28.219252 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.219272 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.220678 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.220683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.222702 (+ 2019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.222712 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.223870 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.223876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.224038 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.224062 (+ 24us) client_negotiation.cc:769] Sending connection context
0805 22:53:28.224195 (+ 133us) client_negotiation.cc:240] Negotiation successful
0805 22:53:28.224343 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"mutex_wait_us":24,"thread_start_us":531,"threads_started":1}
I20260805 22:53:28.225068 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.216820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:36847 (local address 127.20.34.67:34889)
0805 22:53:28.217033 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.217039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.217804 (+ 765us) server_negotiation.cc:407] Connection header received
0805 22:53:28.218186 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.218190 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.218293 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.218388 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:28.219107 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.219986 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.222604 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.223856 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.224019 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.224091 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.224677 (+ 586us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.224828 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 22:53:28.225735 22211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.216418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34889 (local address 127.20.34.66:36847)
0805 22:53:28.217665 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:28.217687 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:28.217933 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:28.218431 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:28.218436 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:28.218473 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:28.218943 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.218956 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.220139 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.220145 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.222428 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:28.222442 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.224269 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.224278 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:28.224471 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.224508 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 22:53:28.225236 (+ 728us) client_negotiation.cc:240] Negotiation successful
0805 22:53:28.225375 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1064,"mutex_wait_us":45,"thread_start_us":821,"threads_started":1}
I20260805 22:53:28.226266 21705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa86f9f4049a489789a68d327e2202a6" candidate_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81797e52714a416aa508b6c7be7e39c7" is_pre_election: true
I20260805 22:53:28.226975 21705 raft_consensus.cc:2454] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24f357b1ca9545bdbbd7ad87fda0fed5 in term 0.
I20260805 22:53:28.226847 22105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa86f9f4049a489789a68d327e2202a6" candidate_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621867116484c09bde6c2e7c04e74e8" is_pre_election: true
I20260805 22:53:28.227427 22105 raft_consensus.cc:2454] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24f357b1ca9545bdbbd7ad87fda0fed5 in term 0.
I20260805 22:53:28.227787 21815 leader_election.cc:302] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24f357b1ca9545bdbbd7ad87fda0fed5, 81797e52714a416aa508b6c7be7e39c7; no voters:
I20260805 22:53:28.228268 22209 raft_consensus.cc:2781] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:28.228430 22209 raft_consensus.cc:482] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:28.228520 22209 raft_consensus.cc:3037] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:28.231745 22209 raft_consensus.cc:504] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.232494 22209 leader_election.cc:288] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [CANDIDATE]: Term 1 election: Requested vote from peers 81797e52714a416aa508b6c7be7e39c7 (127.20.34.65:41933), 4621867116484c09bde6c2e7c04e74e8 (127.20.34.67:34889)
I20260805 22:53:28.232990 22105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa86f9f4049a489789a68d327e2202a6" candidate_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621867116484c09bde6c2e7c04e74e8"
I20260805 22:53:28.232982 21705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa86f9f4049a489789a68d327e2202a6" candidate_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81797e52714a416aa508b6c7be7e39c7"
I20260805 22:53:28.233196 22105 raft_consensus.cc:3037] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:28.233199 21705 raft_consensus.cc:3037] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:28.235523 22105 raft_consensus.cc:2454] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24f357b1ca9545bdbbd7ad87fda0fed5 in term 1.
I20260805 22:53:28.235975 21705 raft_consensus.cc:2454] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24f357b1ca9545bdbbd7ad87fda0fed5 in term 1.
I20260805 22:53:28.236014 21813 leader_election.cc:302] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24f357b1ca9545bdbbd7ad87fda0fed5, 4621867116484c09bde6c2e7c04e74e8; no voters:
I20260805 22:53:28.236429 22209 raft_consensus.cc:2781] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:28.236987 22209 raft_consensus.cc:686] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [term 1 LEADER]: Becoming Leader. State: Replica: 24f357b1ca9545bdbbd7ad87fda0fed5, State: Running, Role: LEADER
W20260805 22:53:28.237092 22174 tablet.cc:2369] T fa86f9f4049a489789a68d327e2202a6 P 4621867116484c09bde6c2e7c04e74e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:53:28.237623 22209 consensus_queue.cc:237] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } }
I20260805 22:53:28.242830 21494 catalog_manager.cc:5495] T fa86f9f4049a489789a68d327e2202a6 P 24f357b1ca9545bdbbd7ad87fda0fed5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24f357b1ca9545bdbbd7ad87fda0fed5 (127.20.34.66). New cstate: current_term: 1 leader_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81797e52714a416aa508b6c7be7e39c7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 41933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24f357b1ca9545bdbbd7ad87fda0fed5" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4621867116484c09bde6c2e7c04e74e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34889 } health_report { overall_health: UNKNOWN } } }
Aug 05 22:53:28 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:28.301517 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.284612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37938 (local address 127.20.34.65:41933)
0805 22:53:28.284825 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.284833 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.285377 (+ 544us) server_negotiation.cc:407] Connection header received
0805 22:53:28.285604 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.285609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.285680 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.285800 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:28.287436 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.288317 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.289626 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.290063 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.290211 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.294461 (+ 4250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:28.294480 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:28.294498 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:28.294543 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:28.297829 (+ 3286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.298738 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.298748 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.298750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.298932 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.299407 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.299414 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.299418 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.299902 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:28.300318 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.300754 (+ 436us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.301036 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
Aug 05 22:53:28 dist-test-slave-gmjp krb5kdc[21432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970408, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:53:28 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970408, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:28.362977 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.348407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37946 (local address 127.20.34.65:41933)
0805 22:53:28.348668 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.348675 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.348876 (+ 201us) server_negotiation.cc:407] Connection header received
0805 22:53:28.349030 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.349035 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.349120 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.349220 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:28.350758 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.351533 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.352907 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.353324 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.353430 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.357591 (+ 4161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:28.357597 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:28.357601 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:28.357640 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:28.360596 (+ 2956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.361202 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.361206 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.361209 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.361343 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.361720 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.361723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.361725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.361989 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:28.362172 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.362422 (+ 250us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.362594 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260805 22:53:28.375289 21769 tablet.cc:2369] T fa86f9f4049a489789a68d327e2202a6 P 81797e52714a416aa508b6c7be7e39c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 22:53:28 dist-test-slave-gmjp krb5kdc[21432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:53:28 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:28.421743 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.406401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37960 (local address 127.20.34.65:41933)
0805 22:53:28.406664 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.406673 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.407039 (+ 366us) server_negotiation.cc:407] Connection header received
0805 22:53:28.407270 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.407275 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.407359 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.407476 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:28.409085 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.409825 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.411186 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.411739 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.411888 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.416199 (+ 4311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:28.416208 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:28.416213 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:28.416273 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:28.419076 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.419820 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.419824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.419826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.420010 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.420457 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.420460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.420462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.420767 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:28.420969 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.421272 (+ 303us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.421484 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260805 22:53:28.424096 21647 tablet_service.cc:2908] Rejecting scan request for tablet fa86f9f4049a489789a68d327e2202a6: Uninitialized: clean time has not yet been initialized
I20260805 22:53:28.431814 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21585
I20260805 22:53:28.446727 22193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.432889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37964 (local address 127.20.34.65:41933)
0805 22:53:28.433107 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.433116 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.433429 (+ 313us) server_negotiation.cc:407] Connection header received
0805 22:53:28.433593 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.433599 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.433698 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.433811 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:28.435106 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.436212 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.437552 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.438196 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.438363 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.440947 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:28.440954 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:28.440960 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:28.441003 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:28.443835 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.444657 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.444662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.444665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.444816 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.445229 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.445233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.445235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.445562 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:28.445934 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.446290 (+ 356us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.446479 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:53:28.447475 21761 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:28.541744 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21585
I20260805 22:53:28.568506 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21782
Aug 05 22:53:28 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:53:28.584719 22194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.569446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55276 (local address 127.20.34.66:36187)
0805 22:53:28.569687 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.569694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.569719 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:53:28.569915 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.569919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.569992 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.570122 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:28.571408 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.572248 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.573619 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.574048 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.574165 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.578598 (+ 4433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:28.578616 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:28.578634 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:28.578676 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:28.581847 (+ 3171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.582586 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.582593 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.582596 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.582789 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.583153 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.583157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.583159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.583520 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:28.583798 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.584096 (+ 298us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.584447 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:53:28.585500 21967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:28.679062 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21782
I20260805 22:53:28.708854 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21989
Aug 05 22:53:28 dist-test-slave-gmjp krb5kdc[21432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:53:28.724879 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:28.709718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43704 (local address 127.20.34.67:34889)
0805 22:53:28.709941 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:28.709947 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:28.709971 (+ 24us) server_negotiation.cc:407] Connection header received
0805 22:53:28.710047 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:28.710053 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:28.710135 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:28.710252 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:28.711539 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.712445 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.713804 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:28.714199 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:28.714342 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:28.718894 (+ 4552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:28.718912 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:28.718930 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:28.718988 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:28.721906 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.722626 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.722634 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.722637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.722794 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:28.723198 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:28.723204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:28.723207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:28.723596 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:28.723914 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:28.724264 (+ 350us) server_negotiation.cc:299] Negotiation successful
0805 22:53:28.724508 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 22:53:28.725589 22164 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:28.815318 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21989
I20260805 22:53:28.842150 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21447
I20260805 22:53:28.843576 21544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:28.956913 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21447
2026-08-05T22:53:28Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4750 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:29 dist-test-slave-gmjp krb5kdc[22240](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:29 dist-test-slave-gmjp krb5kdc[22240](info): set up 2 sockets
Aug 05 22:53:29 dist-test-slave-gmjp krb5kdc[22240](info): commencing operation
krb5kdc: starting...
W20260805 22:53:30.264880 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.007s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:53:30 dist-test-slave-gmjp krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:53:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:53:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:53:30.508724 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39151
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:39151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:30.873485 22262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:30.873847 22262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:30.874066 22262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:30.881860 22262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:53:30.882001 22262 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:53:30.882125 22262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:30.882257 22262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:30.882359 22262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:53:30.882491 22262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:53:30.893270 22262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:39151
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:30.894811 22262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:30.896410 22262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:30.909906 22277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:30.909956 22272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:30.910254 22270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:30.910857 22262 server_base.cc:1034] running on GCE node
I20260805 22:53:30.911731 22262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:30.913390 22262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:30.914680 22262 hybrid_clock.cc:648] HybridClock initialized: now 1785970410914594 us; error 48 us; skew 500 ppm
I20260805 22:53:30.915077 22262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:30 dist-test-slave-gmjp krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970410, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:30.918423 22262 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:53:30.920014 22262 webserver.cc:460] Webserver started at http://127.20.34.126:37993/ using document root <none> and password file <none>
I20260805 22:53:30.920857 22262 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:30.921015 22262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:30.921386 22262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:30.924779 22262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "9eff48aa754f480fbb0de299469f9244"
format_stamp: "Formatted at 2026-08-05 22:53:30 on dist-test-slave-gmjp"
server_key: "bbfa072d8fbe600e525fa35e5bf4a6f1"
server_key_iv: "16b645ef3de722f9a23dad373ca85199"
server_key_version: "encryptionkey@0"
I20260805 22:53:30.925621 22262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "9eff48aa754f480fbb0de299469f9244"
format_stamp: "Formatted at 2026-08-05 22:53:30 on dist-test-slave-gmjp"
server_key: "bbfa072d8fbe600e525fa35e5bf4a6f1"
server_key_iv: "16b645ef3de722f9a23dad373ca85199"
server_key_version: "encryptionkey@0"
I20260805 22:53:30.931507 22262 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:53:30.935549 22286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:30.937151 22262 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:53:30.937371 22262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "9eff48aa754f480fbb0de299469f9244"
format_stamp: "Formatted at 2026-08-05 22:53:30 on dist-test-slave-gmjp"
server_key: "bbfa072d8fbe600e525fa35e5bf4a6f1"
server_key_iv: "16b645ef3de722f9a23dad373ca85199"
server_key_version: "encryptionkey@0"
I20260805 22:53:30.937623 22262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:30.960378 22262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:30.965157 22262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:30.965444 22262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:30.989941 22262 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:39151
I20260805 22:53:30.989981 22372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:39151 every 8 connection(s)
I20260805 22:53:30.991446 22262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:53:30.994076 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 22262
I20260805 22:53:30.994328 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:53:30.995021 20617 external_mini_cluster.cc:1428] Setting key 91d02d07a5944a247875897471de8cdb
I20260805 22:53:30.995700 22373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:31.011690 22373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244: Bootstrap starting.
Aug 05 22:53:31 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:31.015884 22373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:31.017268 22373 log.cc:824] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:31.020787 22373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244: No bootstrap required, opened a new log
I20260805 22:53:31.021596 22378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:30.997166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35848 (local address 127.20.34.126:39151)
0805 22:53:30.998034 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:30.998046 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:30.998090 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:53:31.000777 (+ 2687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:31.000805 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:31.001263 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:31.001656 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:31.003649 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.005162 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.007035 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.007794 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.007949 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:31.013259 (+ 5310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:31.013269 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:31.013286 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:31.013330 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:31.016767 (+ 3437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:31.017731 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:31.017739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:31.017747 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:31.017948 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:31.018433 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:31.018453 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:31.018456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:31.019052 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:31.019383 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:31.019879 (+ 496us) server_negotiation.cc:299] Negotiation successful
0805 22:53:31.020385 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":420,"threads_started":1}
I20260805 22:53:31.029441 22373 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eff48aa754f480fbb0de299469f9244" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39151 } }
I20260805 22:53:31.029881 22373 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:31.030002 22373 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eff48aa754f480fbb0de299469f9244, State: Initialized, Role: FOLLOWER
I20260805 22:53:31.030725 22373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eff48aa754f480fbb0de299469f9244" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39151 } }
I20260805 22:53:31.031025 22373 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:53:31.031204 22373 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:53:31.031400 22373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:31.033811 22373 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eff48aa754f480fbb0de299469f9244" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39151 } }
I20260805 22:53:31.034415 22373 leader_election.cc:302] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eff48aa754f480fbb0de299469f9244; no voters:
I20260805 22:53:31.035092 22373 leader_election.cc:288] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:53:31.035264 22380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:31.036981 22380 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [term 1 LEADER]: Becoming Leader. State: Replica: 9eff48aa754f480fbb0de299469f9244, State: Running, Role: LEADER
I20260805 22:53:31.037557 22380 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eff48aa754f480fbb0de299469f9244" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39151 } }
I20260805 22:53:31.037813 22373 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:53:31.040645 22381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9eff48aa754f480fbb0de299469f9244" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eff48aa754f480fbb0de299469f9244" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39151 } } }
I20260805 22:53:31.041040 22381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:31.041486 22382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eff48aa754f480fbb0de299469f9244. Latest consensus state: current_term: 1 leader_uuid: "9eff48aa754f480fbb0de299469f9244" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eff48aa754f480fbb0de299469f9244" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39151 } } }
I20260805 22:53:31.041770 22382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:31.044026 22390 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:53:31.049320 22390 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:53:31.062279 22390 catalog_manager.cc:1347] Generated new cluster ID: 3b9a74ca6c5445109653c09c91f386c4
I20260805 22:53:31.062505 22390 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:53:31.080251 22390 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:53:31.081682 22390 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:53:31.092558 22390 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244: Generated new TSK 0
I20260805 22:53:31.093504 22390 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:53:31.156072 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39151
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:31.524849 22411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:31.525215 22411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:31.525383 22411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:31.533128 22411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:31.533320 22411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:31.533468 22411 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:53:31.533620 22411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:53:31.544735 22411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:39151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:31.546089 22411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:31.547461 22411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:31.561597 22420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:31.561672 22417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:31.561692 22418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:31.562502 22411 server_base.cc:1034] running on GCE node
I20260805 22:53:31.563153 22411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:31.564479 22411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:31.565714 22411 hybrid_clock.cc:648] HybridClock initialized: now 1785970411565630 us; error 55 us; skew 500 ppm
I20260805 22:53:31.566105 22411 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:31 dist-test-slave-gmjp krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970411, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:31.569640 22411 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:53:31.571395 22411 webserver.cc:460] Webserver started at http://127.20.34.65:43973/ using document root <none> and password file <none>
I20260805 22:53:31.572252 22411 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:31.572394 22411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:31.572748 22411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:31.576009 22411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "c08dd7d4e1b447b5b35fc9c831d01236"
format_stamp: "Formatted at 2026-08-05 22:53:31 on dist-test-slave-gmjp"
server_key: "cfe6c4b459182ae159a1d82c5a5798a1"
server_key_iv: "974d08c903f871e13d3712b8869355ac"
server_key_version: "encryptionkey@0"
I20260805 22:53:31.576982 22411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "c08dd7d4e1b447b5b35fc9c831d01236"
format_stamp: "Formatted at 2026-08-05 22:53:31 on dist-test-slave-gmjp"
server_key: "cfe6c4b459182ae159a1d82c5a5798a1"
server_key_iv: "974d08c903f871e13d3712b8869355ac"
server_key_version: "encryptionkey@0"
I20260805 22:53:31.582656 22411 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:53:31.586485 22433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:31.587937 22411 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:53:31.588135 22411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "c08dd7d4e1b447b5b35fc9c831d01236"
format_stamp: "Formatted at 2026-08-05 22:53:31 on dist-test-slave-gmjp"
server_key: "cfe6c4b459182ae159a1d82c5a5798a1"
server_key_iv: "974d08c903f871e13d3712b8869355ac"
server_key_version: "encryptionkey@0"
I20260805 22:53:31.588440 22411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:31.603946 22411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:31.608836 22411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:31.609149 22411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:31.612390 22411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:31.612501 22411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:31.612686 22411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:31.612761 22411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:53:31 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970411, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:31.637775 22445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:31.612836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:36583 (local address 127.20.34.126:39151)
0805 22:53:31.613323 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:31.613333 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:31.614668 (+ 1335us) server_negotiation.cc:407] Connection header received
0805 22:53:31.616960 (+ 2292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:31.616967 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:31.617070 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:31.617194 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:31.619616 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.620839 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.623725 (+ 2886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.624239 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.624398 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:31.629530 (+ 5132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:31.629536 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:31.629539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:31.629579 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:31.633023 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:31.634182 (+ 1159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:31.634192 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:31.634198 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:31.634428 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:31.635120 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:31.635128 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:31.635132 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:31.635624 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:31.635844 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:31.637121 (+ 1277us) server_negotiation.cc:299] Negotiation successful
0805 22:53:31.637381 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":248,"threads_started":1}
I20260805 22:53:31.638962 22447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:31.613672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39151 (local address 127.20.34.65:36583)
0805 22:53:31.614509 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:31.614547 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:31.616635 (+ 2088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:31.617456 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:31.617464 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:31.618286 (+ 822us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:31.619356 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:31.619399 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.621025 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.621030 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:31.623511 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:31.623535 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.624536 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.624548 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:31.624988 (+ 440us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:31.625966 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:31.626012 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:31.629235 (+ 3223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:31.633200 (+ 3965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:31.633215 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:31.633237 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:31.634024 (+ 787us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:31.634601 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:31.634605 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:31.634608 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:31.634953 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:31.635854 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:31.635870 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:31.636568 (+ 698us) client_negotiation.cc:769] Sending connection context
0805 22:53:31.637017 (+ 449us) client_negotiation.cc:240] Negotiation successful
0805 22:53:31.637642 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":366,"threads_started":1}
I20260805 22:53:31.664970 22445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:31.647526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:56419 (local address 127.20.34.126:39151)
0805 22:53:31.647803 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:31.647817 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:31.648810 (+ 993us) server_negotiation.cc:407] Connection header received
0805 22:53:31.649032 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:31.649036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:31.649105 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:31.649192 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:31.650761 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.651464 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.654067 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.654675 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.654835 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:31.658145 (+ 3310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:31.658150 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:31.658153 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:31.658190 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:31.661609 (+ 3419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:31.662752 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:31.662757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:31.662759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:31.662903 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:31.663376 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:31.663379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:31.663381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:31.663646 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:31.663788 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:31.664428 (+ 640us) server_negotiation.cc:299] Negotiation successful
0805 22:53:31.664682 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 22:53:31.665473 22530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:31.647477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39151 (local address 127.20.34.65:56419)
0805 22:53:31.648653 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:31.648686 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:31.648897 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:31.649266 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:31.649275 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:31.650076 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:31.650581 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:31.650599 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.651616 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.651624 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:31.653856 (+ 2232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:31.653878 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:31.654960 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:31.654970 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:31.655264 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:31.656272 (+ 1008us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:31.656305 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:31.657892 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:31.661780 (+ 3888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:31.661789 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:31.661797 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:31.662586 (+ 789us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:31.663027 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:31.663035 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:31.663041 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:31.663250 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:31.663773 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:31.663780 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:31.664057 (+ 277us) client_negotiation.cc:769] Sending connection context
0805 22:53:31.664285 (+ 228us) client_negotiation.cc:240] Negotiation successful
0805 22:53:31.664810 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":961,"thread_start_us":786,"threads_started":1}
I20260805 22:53:31.673532 22411 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34009
I20260805 22:53:31.673561 22610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34009 every 8 connection(s)
I20260805 22:53:31.674789 22411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:53:31.676760 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 22411
I20260805 22:53:31.677042 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:53:31.677244 22611 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39151
I20260805 22:53:31.677485 22611 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:31.677789 20617 external_mini_cluster.cc:1428] Setting key e5ccee9e733200cb738bf206707db28b
I20260805 22:53:31.678228 22611 heartbeater.cc:511] Master 127.20.34.126:39151 requested a full tablet report, sending...
I20260805 22:53:31.680738 22306 ts_manager.cc:194] Registered new tserver with Master: c08dd7d4e1b447b5b35fc9c831d01236 (127.20.34.65:34009)
I20260805 22:53:31.682238 22306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:36583
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:53:31.731842 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39151
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:32.098913 22617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:32.099309 22617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:32.099507 22617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:32.107457 22617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:32.107668 22617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:32.107847 22617 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:53:32.108006 22617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:53:32.118762 22617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:39151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:32.120337 22617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:32.121922 22617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:32.136910 22629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:32.136988 22624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:32.136941 22627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:32.137920 22617 server_base.cc:1034] running on GCE node
I20260805 22:53:32.138718 22617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:32.139765 22617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:32.141050 22617 hybrid_clock.cc:648] HybridClock initialized: now 1785970412140955 us; error 70 us; skew 500 ppm
I20260805 22:53:32.141484 22617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:32 dist-test-slave-gmjp krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:32.148694 22617 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:53:32.150396 22617 webserver.cc:460] Webserver started at http://127.20.34.66:44685/ using document root <none> and password file <none>
I20260805 22:53:32.151197 22617 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:32.151350 22617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:32.151713 22617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:32.154961 22617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "d879e25056c8444aa0eea6efddcdbc61"
format_stamp: "Formatted at 2026-08-05 22:53:32 on dist-test-slave-gmjp"
server_key: "bf2173a1ede88e1b647dc064c55c33d6"
server_key_iv: "7d04ddc3384c45d6468541786eb3cc5d"
server_key_version: "encryptionkey@0"
I20260805 22:53:32.155861 22617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "d879e25056c8444aa0eea6efddcdbc61"
format_stamp: "Formatted at 2026-08-05 22:53:32 on dist-test-slave-gmjp"
server_key: "bf2173a1ede88e1b647dc064c55c33d6"
server_key_iv: "7d04ddc3384c45d6468541786eb3cc5d"
server_key_version: "encryptionkey@0"
I20260805 22:53:32.161582 22617 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260805 22:53:32.165676 22641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:32.167407 22617 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260805 22:53:32.167618 22617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "d879e25056c8444aa0eea6efddcdbc61"
format_stamp: "Formatted at 2026-08-05 22:53:32 on dist-test-slave-gmjp"
server_key: "bf2173a1ede88e1b647dc064c55c33d6"
server_key_iv: "7d04ddc3384c45d6468541786eb3cc5d"
server_key_version: "encryptionkey@0"
I20260805 22:53:32.167882 22617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:32.186195 22617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:32.191249 22617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:32.191612 22617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:32.195115 22617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:32.195259 22617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:32.195474 22617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:32.195566 22617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:53:32 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:32.222787 22653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.195543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:55185 (local address 127.20.34.126:39151)
0805 22:53:32.196180 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:32.196188 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:32.197681 (+ 1493us) server_negotiation.cc:407] Connection header received
0805 22:53:32.201453 (+ 3772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:32.201461 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:32.201591 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:32.201728 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:32.204657 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.205822 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.207682 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.208134 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.208347 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.214464 (+ 6117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:32.214472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:32.214478 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:32.214540 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:32.218456 (+ 3916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.219643 (+ 1187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.219649 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.219653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.219869 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.220704 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.220712 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.220717 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.221056 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:32.221245 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:32.222074 (+ 829us) server_negotiation.cc:299] Negotiation successful
0805 22:53:32.222332 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":277,"threads_started":1}
I20260805 22:53:32.223899 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.196366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39151 (local address 127.20.34.66:55185)
0805 22:53:32.197422 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:32.197486 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:32.200933 (+ 3447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:32.202236 (+ 1303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:32.202255 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:32.203222 (+ 967us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:32.204406 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.204433 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.206017 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.206021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.207516 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.207530 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.208491 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.208503 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.208859 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.209839 (+ 980us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:32.209897 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:32.214035 (+ 4138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:32.218659 (+ 4624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:32.218671 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:32.218693 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:32.219486 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:32.220039 (+ 553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:32.220048 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:32.220055 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:32.220496 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:32.221210 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:32.221224 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:32.221665 (+ 441us) client_negotiation.cc:769] Sending connection context
0805 22:53:32.221961 (+ 296us) client_negotiation.cc:240] Negotiation successful
0805 22:53:32.222576 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":440,"threads_started":1}
I20260805 22:53:32.246474 22653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.231111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:47085 (local address 127.20.34.126:39151)
0805 22:53:32.231284 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:32.231288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:32.232055 (+ 767us) server_negotiation.cc:407] Connection header received
0805 22:53:32.232348 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:32.232352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:32.232422 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:32.232530 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:32.233899 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.234825 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.236854 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.237303 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.237465 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.239764 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:32.239770 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:32.239773 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:32.239809 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:32.243138 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.244025 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.244031 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.244037 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.244221 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.244658 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.244668 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.244673 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.245108 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:32.245266 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:32.245858 (+ 592us) server_negotiation.cc:299] Negotiation successful
0805 22:53:32.246123 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:53:32.246618 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.231252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39151 (local address 127.20.34.66:47085)
0805 22:53:32.231936 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:32.231952 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:32.232130 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:32.232565 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:32.232570 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:32.233266 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:32.233730 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.233742 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.234991 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.234996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.236689 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.236707 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.237539 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.237547 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.237837 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.238653 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:32.238672 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:32.239531 (+ 859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:32.243292 (+ 3761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:32.243299 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:32.243303 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:32.243896 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:32.244350 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:32.244355 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:32.244366 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:32.244517 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:32.245253 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:32.245261 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:32.245556 (+ 295us) client_negotiation.cc:769] Sending connection context
0805 22:53:32.245755 (+ 199us) client_negotiation.cc:240] Negotiation successful
0805 22:53:32.246154 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":413,"threads_started":1}
I20260805 22:53:32.262636 22617 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:37795
I20260805 22:53:32.262655 22821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:37795 every 8 connection(s)
I20260805 22:53:32.264050 22617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:53:32.266531 22822 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39151
I20260805 22:53:32.266765 22822 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:32.267529 22822 heartbeater.cc:511] Master 127.20.34.126:39151 requested a full tablet report, sending...
I20260805 22:53:32.268589 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 22617
I20260805 22:53:32.268850 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:53:32.269286 22306 ts_manager.cc:194] Registered new tserver with Master: d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795)
I20260805 22:53:32.269436 20617 external_mini_cluster.cc:1428] Setting key 950b598bc7c2a4314e57ea4eef7619fc
I20260805 22:53:32.270421 22306 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:55185
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:53:32.323716 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39151
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:32.683192 22827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:32.683533 22827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:32.683717 22827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260805 22:53:32.685295 22611 heartbeater.cc:503] Master 127.20.34.126:39151 was elected leader, sending a full tablet report...
W20260805 22:53:32.691955 22827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:32.692205 22827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:32.692329 22827 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:53:32.692420 22827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:53:32.702833 22827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:39151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:32.704213 22827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:32.705655 22827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:32.719714 22835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:32.719666 22837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:32.719657 22840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:32.720744 22827 server_base.cc:1034] running on GCE node
I20260805 22:53:32.721575 22827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:32.722602 22827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:32.723858 22827 hybrid_clock.cc:648] HybridClock initialized: now 1785970412723788 us; error 44 us; skew 500 ppm
I20260805 22:53:32.724252 22827 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:32 dist-test-slave-gmjp krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:32.727705 22827 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:53:32.729249 22827 webserver.cc:460] Webserver started at http://127.20.34.67:35777/ using document root <none> and password file <none>
I20260805 22:53:32.730003 22827 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:32.730122 22827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:32.730482 22827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:32.733668 22827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "9b47a355470244cabddf2eadeb8a9357"
format_stamp: "Formatted at 2026-08-05 22:53:32 on dist-test-slave-gmjp"
server_key: "5d76c21cb73fba52cd909072e2e72cc2"
server_key_iv: "bf44b2ea7f4047980fc865bbff8886a8"
server_key_version: "encryptionkey@0"
I20260805 22:53:32.734618 22827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "9b47a355470244cabddf2eadeb8a9357"
format_stamp: "Formatted at 2026-08-05 22:53:32 on dist-test-slave-gmjp"
server_key: "5d76c21cb73fba52cd909072e2e72cc2"
server_key_iv: "bf44b2ea7f4047980fc865bbff8886a8"
server_key_version: "encryptionkey@0"
I20260805 22:53:32.740540 22827 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260805 22:53:32.744730 22848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:32.746162 22827 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:53:32.746416 22827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "9b47a355470244cabddf2eadeb8a9357"
format_stamp: "Formatted at 2026-08-05 22:53:32 on dist-test-slave-gmjp"
server_key: "5d76c21cb73fba52cd909072e2e72cc2"
server_key_iv: "bf44b2ea7f4047980fc865bbff8886a8"
server_key_version: "encryptionkey@0"
I20260805 22:53:32.746661 22827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:32.783061 22827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:32.787528 22827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:32.787839 22827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:32.791002 22827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:32.791090 22827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:32.791258 22827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:32.791339 22827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:53:32 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:32.821501 22861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.792430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:39837 (local address 127.20.34.126:39151)
0805 22:53:32.792995 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:32.793001 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:32.794505 (+ 1504us) server_negotiation.cc:407] Connection header received
0805 22:53:32.797400 (+ 2895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:32.797411 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:32.797541 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:32.797691 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:32.800913 (+ 3222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.802334 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.805505 (+ 3171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.806335 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.806524 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.812562 (+ 6038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:32.812572 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:32.812580 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:32.812644 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:32.816425 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.817692 (+ 1267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.817699 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.817703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.817921 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.818612 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.818620 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.818626 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.819099 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:32.819293 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:32.820475 (+ 1182us) server_negotiation.cc:299] Negotiation successful
0805 22:53:32.820884 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":300,"threads_started":1}
I20260805 22:53:32.822183 22864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.793272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39151 (local address 127.20.34.67:39837)
0805 22:53:32.794283 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:32.794338 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:32.796882 (+ 2544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:32.798105 (+ 1223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:32.798120 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:32.799269 (+ 1149us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:32.800573 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.800617 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.802646 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.802654 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.805256 (+ 2602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.805290 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.806722 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.806742 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.807242 (+ 500us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.808600 (+ 1358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:32.808646 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:32.812121 (+ 3475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:32.816647 (+ 4526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:32.816654 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:32.816671 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:32.817467 (+ 796us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:32.818080 (+ 613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:32.818085 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:32.818089 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:32.818422 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:32.819304 (+ 882us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:32.819317 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:32.819921 (+ 604us) client_negotiation.cc:769] Sending connection context
0805 22:53:32.820304 (+ 383us) client_negotiation.cc:240] Negotiation successful
0805 22:53:32.820771 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":455,"threads_started":1}
I20260805 22:53:32.851141 22827 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:42169
I20260805 22:53:32.851222 23029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:42169 every 8 connection(s)
I20260805 22:53:32.853036 22827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:53:32.855561 22861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.830111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:39453 (local address 127.20.34.126:39151)
0805 22:53:32.830312 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:32.830316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:32.837605 (+ 7289us) server_negotiation.cc:407] Connection header received
0805 22:53:32.837870 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:32.837878 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:32.837986 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:32.838102 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:32.840003 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.841172 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.843832 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.844683 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.844870 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.848021 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:32.848031 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:32.848039 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:32.848090 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:32.852068 (+ 3978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.853030 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.853035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.853037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.853181 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.853652 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.853660 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.853665 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.854104 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:32.854282 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:32.854945 (+ 663us) server_negotiation.cc:299] Negotiation successful
0805 22:53:32.855205 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 22:53:32.855851 23030 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39151
I20260805 22:53:32.856066 23030 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:32.856597 22977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.832450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39151 (local address 127.20.34.67:39453)
0805 22:53:32.837413 (+ 4963us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:32.837444 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:32.837670 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:32.838190 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:32.838198 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:32.839173 (+ 975us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:32.839797 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.839815 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.841364 (+ 1549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.841370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.843647 (+ 2277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.843671 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.844968 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.844978 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.845281 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.846137 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:32.846171 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:32.847756 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:32.852286 (+ 4530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:32.852292 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:32.852296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:32.852882 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:32.853314 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:32.853319 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:32.853323 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:32.853489 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:32.854288 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:32.854296 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:32.854602 (+ 306us) client_negotiation.cc:769] Sending connection context
0805 22:53:32.855774 (+ 1172us) client_negotiation.cc:240] Negotiation successful
0805 22:53:32.856260 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4686,"thread_start_us":4520,"threads_started":1}
I20260805 22:53:32.856966 23030 heartbeater.cc:511] Master 127.20.34.126:39151 requested a full tablet report, sending...
I20260805 22:53:32.858433 22309 ts_manager.cc:194] Registered new tserver with Master: 9b47a355470244cabddf2eadeb8a9357 (127.20.34.67:42169)
I20260805 22:53:32.859508 22309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:39837
I20260805 22:53:32.861043 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 22827
I20260805 22:53:32.861253 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:53:32.861809 20617 external_mini_cluster.cc:1428] Setting key 775ce8369d159078e7baba58c8cd06e8
I20260805 22:53:32.865330 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:53:32 dist-test-slave-gmjp krb5kdc[22240](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:53:32 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:32.927198 22861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.909795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57672 (local address 127.20.34.126:39151)
0805 22:53:32.910001 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:32.910007 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:32.910308 (+ 301us) server_negotiation.cc:407] Connection header received
0805 22:53:32.910529 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:32.910534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:32.910626 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:32.910762 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:32.912566 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.913772 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.915241 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.915653 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.915795 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.920736 (+ 4941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:32.920743 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:32.920747 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:32.920796 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:32.923983 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.924943 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.924948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.924951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.925101 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:32.925535 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:32.925539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:32.925541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:32.926008 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:32.926231 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:32.926538 (+ 307us) server_negotiation.cc:299] Negotiation successful
0805 22:53:32.926817 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:53:32.932363 22309 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:53:32.939857 22309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:32.988425 23054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.953665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:42169 (local address 127.0.0.1:53794)
0805 22:53:32.978459 (+ 24794us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:32.978480 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:32.978609 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:32.980249 (+ 1640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:32.980253 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:32.980311 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:32.981082 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.981100 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.983074 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.983079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.985112 (+ 2033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.985144 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.986954 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.986961 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.987430 (+ 469us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.987489 (+ 59us) client_negotiation.cc:769] Sending connection context
0805 22:53:32.987672 (+ 183us) client_negotiation.cc:240] Negotiation successful
0805 22:53:32.987891 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24623,"mutex_wait_us":107,"spinlock_wait_cycles":9472,"thread_start_us":25159,"threads_started":1}
I20260805 22:53:32.988523 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.953431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34009 (local address 127.0.0.1:36266)
0805 22:53:32.967586 (+ 14155us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:32.967656 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:32.967932 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:32.979970 (+ 12038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:32.979978 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:32.980010 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:32.980598 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.980613 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.982751 (+ 2138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.982757 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.985788 (+ 3031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.985807 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.987678 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.987686 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.987868 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.987897 (+ 29us) client_negotiation.cc:769] Sending connection context
0805 22:53:32.987982 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 22:53:32.988127 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13692,"mutex_wait_us":52,"thread_start_us":14798,"threads_started":1}
I20260805 22:53:32.989037 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.953824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36266 (local address 127.20.34.65:34009)
0805 22:53:32.979160 (+ 25336us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:32.979170 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:32.979203 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:53:32.979346 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:32.979357 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:32.979692 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:32.979956 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:32.980966 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.982594 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.985996 (+ 3402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.987432 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.987590 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.987815 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:32.988084 (+ 269us) server_negotiation.cc:299] Negotiation successful
0805 22:53:32.988301 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25156,"thread_start_us":25018,"threads_started":1}
I20260805 22:53:32.989603 23055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.954404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53794 (local address 127.20.34.67:42169)
0805 22:53:32.979612 (+ 25208us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:32.979619 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:32.979652 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:53:32.979746 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:32.979753 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:32.979969 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:32.980380 (+ 411us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:32.981340 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.982899 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.985348 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.986752 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.986895 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.987171 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:32.989041 (+ 1870us) server_negotiation.cc:299] Negotiation successful
0805 22:53:32.989231 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25027,"thread_start_us":24928,"threads_started":1}
I20260805 22:53:32.989933 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.954141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37795 (local address 127.0.0.1:41804)
0805 22:53:32.979086 (+ 24945us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:32.979105 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:32.979244 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:32.980240 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:32.980244 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:32.980297 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:32.980973 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.981360 (+ 387us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.983106 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.983111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.985797 (+ 2686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:32.985807 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.989019 (+ 3212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.989026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:32.989198 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.989229 (+ 31us) client_negotiation.cc:769] Sending connection context
0805 22:53:32.989312 (+ 83us) client_negotiation.cc:240] Negotiation successful
0805 22:53:32.989459 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24823,"mutex_wait_us":57,"spinlock_wait_cycles":4864,"thread_start_us":24003,"threads_started":1}
I20260805 22:53:32.990638 23056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:32.954795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41804 (local address 127.20.34.66:37795)
0805 22:53:32.978111 (+ 23316us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:32.978125 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:32.979243 (+ 1118us) server_negotiation.cc:407] Connection header received
0805 22:53:32.979396 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:32.979405 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:32.979670 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:32.979957 (+ 287us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:32.981573 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.982945 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.987308 (+ 4363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:32.988779 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:32.988922 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:32.989117 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:32.990156 (+ 1039us) server_negotiation.cc:299] Negotiation successful
0805 22:53:32.990328 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23077,"thread_start_us":23533,"threads_started":1}
I20260805 22:53:32.993405 22926 tablet_service.cc:1467] Processing CreateTablet for tablet b0f9bf7ae31c41edac38e5b83159fed8 (DEFAULT_TABLE table=test-table [id=8c867106906b4f958d7870d5ed4341da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:32.993394 22502 tablet_service.cc:1467] Processing CreateTablet for tablet b0f9bf7ae31c41edac38e5b83159fed8 (DEFAULT_TABLE table=test-table [id=8c867106906b4f958d7870d5ed4341da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:32.994697 22926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0f9bf7ae31c41edac38e5b83159fed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:32.994724 22502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0f9bf7ae31c41edac38e5b83159fed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:32.999898 22718 tablet_service.cc:1467] Processing CreateTablet for tablet b0f9bf7ae31c41edac38e5b83159fed8 (DEFAULT_TABLE table=test-table [id=8c867106906b4f958d7870d5ed4341da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:33.001437 22718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0f9bf7ae31c41edac38e5b83159fed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:33.012495 23057 tablet_bootstrap.cc:492] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Bootstrap starting.
I20260805 22:53:33.016675 23057 tablet_bootstrap.cc:654] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.018546 23057 log.cc:824] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:33.019775 23061 tablet_bootstrap.cc:492] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: Bootstrap starting.
I20260805 22:53:33.024995 23060 tablet_bootstrap.cc:492] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: Bootstrap starting.
I20260805 22:53:33.026512 23061 tablet_bootstrap.cc:654] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.027976 23061 log.cc:824] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:33.028385 23057 tablet_bootstrap.cc:492] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: No bootstrap required, opened a new log
I20260805 22:53:33.028761 23057 ts_tablet_manager.cc:1397] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.003s
I20260805 22:53:33.029127 23060 tablet_bootstrap.cc:654] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.030459 23060 log.cc:824] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:33.031347 23061 tablet_bootstrap.cc:492] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: No bootstrap required, opened a new log
I20260805 22:53:33.031632 23061 ts_tablet_manager.cc:1397] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260805 22:53:33.033629 23060 tablet_bootstrap.cc:492] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: No bootstrap required, opened a new log
I20260805 22:53:33.033906 23060 ts_tablet_manager.cc:1397] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260805 22:53:33.037019 23057 raft_consensus.cc:348] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.037837 23057 raft_consensus.cc:374] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.037969 23057 raft_consensus.cc:729] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b47a355470244cabddf2eadeb8a9357, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.038650 23057 consensus_queue.cc:260] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.040443 23030 heartbeater.cc:503] Master 127.20.34.126:39151 was elected leader, sending a full tablet report...
I20260805 22:53:33.041232 23057 ts_tablet_manager.cc:1428] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260805 22:53:33.042862 23061 raft_consensus.cc:348] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.043318 23061 raft_consensus.cc:374] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.043449 23061 raft_consensus.cc:729] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d879e25056c8444aa0eea6efddcdbc61, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.044234 23061 consensus_queue.cc:260] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.045495 22822 heartbeater.cc:503] Master 127.20.34.126:39151 was elected leader, sending a full tablet report...
I20260805 22:53:33.045449 23060 raft_consensus.cc:348] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.045903 23060 raft_consensus.cc:374] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.045998 23060 raft_consensus.cc:729] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c08dd7d4e1b447b5b35fc9c831d01236, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.046343 23061 ts_tablet_manager.cc:1428] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260805 22:53:33.046594 23060 consensus_queue.cc:260] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.048393 23060 ts_tablet_manager.cc:1428] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260805 22:53:33.063143 23065 raft_consensus.cc:482] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:33.063470 23065 raft_consensus.cc:504] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.065363 23065 leader_election.cc:288] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c08dd7d4e1b447b5b35fc9c831d01236 (127.20.34.65:34009), d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795)
I20260805 22:53:33.073491 23056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.065902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:58017 (local address 127.20.34.66:37795)
0805 22:53:33.066150 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.066158 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.066782 (+ 624us) server_negotiation.cc:407] Connection header received
0805 22:53:33.067001 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.067005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.067067 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.067143 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:33.067674 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.068679 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.071103 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.072404 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.072574 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.072643 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.073079 (+ 436us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.073229 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:53:33.073491 23053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.065839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:42453 (local address 127.20.34.65:34009)
0805 22:53:33.066072 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.066079 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.066283 (+ 204us) server_negotiation.cc:407] Connection header received
0805 22:53:33.066540 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.066547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.066621 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.066705 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:33.067244 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.068331 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.070899 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.072314 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.072528 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.072616 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.073079 (+ 463us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.073241 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 22:53:33.073491 22864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.065780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34009 (local address 127.20.34.67:42453)
0805 22:53:33.066135 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:33.066160 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:33.066355 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:33.066773 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:33.066778 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:33.066810 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:33.067064 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.067073 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.068501 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.068505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.070677 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.070694 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.072542 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.072551 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.072789 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.072831 (+ 42us) client_negotiation.cc:769] Sending connection context
0805 22:53:33.072946 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 22:53:33.073107 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":1,"spinlock_wait_cycles":34048}
I20260805 22:53:33.073603 23072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.065871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37795 (local address 127.20.34.67:58017)
0805 22:53:33.066629 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:33.066643 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:33.066853 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:33.067189 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:33.067196 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:33.067230 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:33.067496 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.067504 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.068850 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.068855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.070921 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.070932 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.072624 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.072630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.072868 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.072911 (+ 43us) client_negotiation.cc:769] Sending connection context
0805 22:53:33.072996 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 22:53:33.073222 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":27,"spinlock_wait_cycles":34048,"thread_start_us":384,"threads_started":1}
I20260805 22:53:33.074767 22752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f9bf7ae31c41edac38e5b83159fed8" candidate_uuid: "9b47a355470244cabddf2eadeb8a9357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d879e25056c8444aa0eea6efddcdbc61" is_pre_election: true
I20260805 22:53:33.074754 22539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f9bf7ae31c41edac38e5b83159fed8" candidate_uuid: "9b47a355470244cabddf2eadeb8a9357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" is_pre_election: true
I20260805 22:53:33.075389 22539 raft_consensus.cc:2454] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b47a355470244cabddf2eadeb8a9357 in term 0.
I20260805 22:53:33.075389 22752 raft_consensus.cc:2454] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b47a355470244cabddf2eadeb8a9357 in term 0.
I20260805 22:53:33.076325 22852 leader_election.cc:302] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9b47a355470244cabddf2eadeb8a9357, c08dd7d4e1b447b5b35fc9c831d01236, d879e25056c8444aa0eea6efddcdbc61; no voters:
I20260805 22:53:33.076901 23065 raft_consensus.cc:2781] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:33.077059 23065 raft_consensus.cc:482] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:33.077243 23065 raft_consensus.cc:3037] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.079634 23065 raft_consensus.cc:504] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.080374 23065 leader_election.cc:288] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [CANDIDATE]: Term 1 election: Requested vote from peers c08dd7d4e1b447b5b35fc9c831d01236 (127.20.34.65:34009), d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795)
I20260805 22:53:33.080994 22539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f9bf7ae31c41edac38e5b83159fed8" candidate_uuid: "9b47a355470244cabddf2eadeb8a9357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c08dd7d4e1b447b5b35fc9c831d01236"
I20260805 22:53:33.080994 22752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f9bf7ae31c41edac38e5b83159fed8" candidate_uuid: "9b47a355470244cabddf2eadeb8a9357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d879e25056c8444aa0eea6efddcdbc61"
I20260805 22:53:33.081233 22752 raft_consensus.cc:3037] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.081231 22539 raft_consensus.cc:3037] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.084625 22752 raft_consensus.cc:2454] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b47a355470244cabddf2eadeb8a9357 in term 1.
I20260805 22:53:33.084617 22539 raft_consensus.cc:2454] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b47a355470244cabddf2eadeb8a9357 in term 1.
I20260805 22:53:33.085132 22852 leader_election.cc:302] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b47a355470244cabddf2eadeb8a9357, d879e25056c8444aa0eea6efddcdbc61; no voters:
I20260805 22:53:33.085465 23065 raft_consensus.cc:2781] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:33.085949 23065 raft_consensus.cc:686] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 1 LEADER]: Becoming Leader. State: Replica: 9b47a355470244cabddf2eadeb8a9357, State: Running, Role: LEADER
I20260805 22:53:33.086472 23065 consensus_queue.cc:237] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } }
I20260805 22:53:33.091754 22309 catalog_manager.cc:5495] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b47a355470244cabddf2eadeb8a9357 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "9b47a355470244cabddf2eadeb8a9357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } health_report { overall_health: UNKNOWN } } }
W20260805 22:53:33.105624 23031 tablet.cc:2369] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:53:33.122519 23055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.116144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53798 (local address 127.20.34.67:42169)
0805 22:53:33.116423 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.116429 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.116455 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:53:33.116871 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.116877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.116980 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.117147 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:33.117540 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.118424 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.119953 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.120503 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.120626 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.121240 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:33.121919 (+ 679us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:33.122052 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.122199 (+ 147us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.122280 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 22:53:33.132714 22752 raft_consensus.cc:1261] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Refusing update from remote peer 9b47a355470244cabddf2eadeb8a9357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:33.132728 22539 raft_consensus.cc:1261] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Refusing update from remote peer 9b47a355470244cabddf2eadeb8a9357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:33.133741 23065 consensus_queue.cc:1035] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:33.134047 23073 consensus_queue.cc:1035] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:33.148077 23076 mvcc.cc:205] Tried to move back new op lower bound from 7315334812179456000 to 7315334812006707200. Current Snapshot: MvccSnapshot[applied={T|T < 7315334812179456000}]
I20260805 22:53:33.174322 22306 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:33.174625 22306 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:33.179020 22306 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244: Sending DeleteTablet for 3 replicas of tablet b0f9bf7ae31c41edac38e5b83159fed8
I20260805 22:53:33.180500 22502 tablet_service.cc:1514] Processing DeleteTablet for tablet b0f9bf7ae31c41edac38e5b83159fed8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:33 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:36266
I20260805 22:53:33.180574 22718 tablet_service.cc:1514] Processing DeleteTablet for tablet b0f9bf7ae31c41edac38e5b83159fed8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:33 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:41804
I20260805 22:53:33.180615 22926 tablet_service.cc:1514] Processing DeleteTablet for tablet b0f9bf7ae31c41edac38e5b83159fed8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:33 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:53794
I20260805 22:53:33.195199 22306 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:53:33.196245 22306 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:33.196678 23100 tablet_replica.cc:330] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: stopping tablet replica
I20260805 22:53:33.197487 23100 raft_consensus.cc:2229] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:53:33.198458 23100 raft_consensus.cc:2258] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:33.199880 23099 tablet_replica.cc:330] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: stopping tablet replica
I20260805 22:53:33.200629 23102 tablet_replica.cc:330] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: stopping tablet replica
I20260805 22:53:33.201190 23102 raft_consensus.cc:2229] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:33.201359 23100 ts_tablet_manager.cc:1905] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:33.204845 23099 raft_consensus.cc:2229] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:33.205533 23102 raft_consensus.cc:2258] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:33.206872 23099 raft_consensus.cc:2258] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:33.209379 22926 tablet_service.cc:1467] Processing CreateTablet for tablet e3fe1aa6a07f40519224057279577ec1 (DEFAULT_TABLE table=test-table [id=ca55851bc96942f0a19fbf12466d34dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:33.209589 23099 ts_tablet_manager.cc:1905] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:33.209941 22926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fe1aa6a07f40519224057279577ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:33.210527 23100 ts_tablet_manager.cc:1918] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:53:33.210804 23100 log.cc:1196] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/b0f9bf7ae31c41edac38e5b83159fed8
I20260805 22:53:33.211541 23100 ts_tablet_manager.cc:1939] T b0f9bf7ae31c41edac38e5b83159fed8 P 9b47a355470244cabddf2eadeb8a9357: Deleting consensus metadata
I20260805 22:53:33.213709 22290 catalog_manager.cc:4841] TS 9b47a355470244cabddf2eadeb8a9357 (127.20.34.67:42169): tablet b0f9bf7ae31c41edac38e5b83159fed8 (table test-table [id=8c867106906b4f958d7870d5ed4341da]) successfully deleted
I20260805 22:53:33.214388 22718 tablet_service.cc:1467] Processing CreateTablet for tablet e3fe1aa6a07f40519224057279577ec1 (DEFAULT_TABLE table=test-table [id=ca55851bc96942f0a19fbf12466d34dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:33.214879 22718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fe1aa6a07f40519224057279577ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:33.216706 23099 ts_tablet_manager.cc:1918] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:53:33.216879 23099 log.cc:1196] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/b0f9bf7ae31c41edac38e5b83159fed8
I20260805 22:53:33.217296 22502 tablet_service.cc:1467] Processing CreateTablet for tablet e3fe1aa6a07f40519224057279577ec1 (DEFAULT_TABLE table=test-table [id=ca55851bc96942f0a19fbf12466d34dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:33.220422 23061 tablet_bootstrap.cc:492] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: Bootstrap starting.
I20260805 22:53:33.221097 23057 tablet_bootstrap.cc:492] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: Bootstrap starting.
I20260805 22:53:33.221172 22502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fe1aa6a07f40519224057279577ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:33.222230 23061 tablet_bootstrap.cc:654] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.222936 23057 tablet_bootstrap.cc:654] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.226962 23102 ts_tablet_manager.cc:1905] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:33.217478 23099 ts_tablet_manager.cc:1939] T b0f9bf7ae31c41edac38e5b83159fed8 P c08dd7d4e1b447b5b35fc9c831d01236: Deleting consensus metadata
I20260805 22:53:33.229023 23060 tablet_bootstrap.cc:492] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: Bootstrap starting.
I20260805 22:53:33.230733 23060 tablet_bootstrap.cc:654] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.233646 22287 catalog_manager.cc:4841] TS c08dd7d4e1b447b5b35fc9c831d01236 (127.20.34.65:34009): tablet b0f9bf7ae31c41edac38e5b83159fed8 (table test-table [id=8c867106906b4f958d7870d5ed4341da]) successfully deleted
I20260805 22:53:33.235297 23057 tablet_bootstrap.cc:492] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: No bootstrap required, opened a new log
I20260805 22:53:33.235483 23057 ts_tablet_manager.cc:1397] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20260805 22:53:33.236694 23061 tablet_bootstrap.cc:492] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: No bootstrap required, opened a new log
I20260805 22:53:33.236567 23057 raft_consensus.cc:348] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.236836 23057 raft_consensus.cc:374] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.236949 23057 raft_consensus.cc:729] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b47a355470244cabddf2eadeb8a9357, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.237107 23061 ts_tablet_manager.cc:1397] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.005s
I20260805 22:53:33.237298 23057 consensus_queue.cc:260] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.238117 23061 raft_consensus.cc:348] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.238502 23061 raft_consensus.cc:374] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.238675 23061 raft_consensus.cc:729] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d879e25056c8444aa0eea6efddcdbc61, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.239034 23061 consensus_queue.cc:260] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.239889 23060 tablet_bootstrap.cc:492] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: No bootstrap required, opened a new log
I20260805 22:53:33.239902 23061 ts_tablet_manager.cc:1428] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260805 22:53:33.240062 23060 ts_tablet_manager.cc:1397] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260805 22:53:33.240672 23057 ts_tablet_manager.cc:1428] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260805 22:53:33.240991 23060 raft_consensus.cc:348] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.241221 23060 raft_consensus.cc:374] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.241304 23060 raft_consensus.cc:729] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c08dd7d4e1b447b5b35fc9c831d01236, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.243494 23102 ts_tablet_manager.cc:1918] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:53:33.243938 23102 log.cc:1196] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/b0f9bf7ae31c41edac38e5b83159fed8
I20260805 22:53:33.244132 23060 consensus_queue.cc:260] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.244594 23102 ts_tablet_manager.cc:1939] T b0f9bf7ae31c41edac38e5b83159fed8 P d879e25056c8444aa0eea6efddcdbc61: Deleting consensus metadata
I20260805 22:53:33.244998 23060 ts_tablet_manager.cc:1428] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260805 22:53:33.247174 22288 catalog_manager.cc:4841] TS d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795): tablet b0f9bf7ae31c41edac38e5b83159fed8 (table test-table [id=8c867106906b4f958d7870d5ed4341da]) successfully deleted
W20260805 22:53:33.266726 22824 tablet.cc:2369] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:53:33.396615 23068 raft_consensus.cc:482] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:33.396893 23068 raft_consensus.cc:504] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.398674 23068 leader_election.cc:288] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795), 9b47a355470244cabddf2eadeb8a9357 (127.20.34.67:42169)
I20260805 22:53:33.407846 23056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.399513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:48647 (local address 127.20.34.66:37795)
0805 22:53:33.399880 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.399886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.400756 (+ 870us) server_negotiation.cc:407] Connection header received
0805 22:53:33.400938 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.400943 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.401020 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.401108 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:33.401834 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.402946 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.405376 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.406425 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.406630 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.406739 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.407352 (+ 613us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.407512 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256}
I20260805 22:53:33.407866 23055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.399400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:36729 (local address 127.20.34.67:42169)
0805 22:53:33.399737 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.399744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.400382 (+ 638us) server_negotiation.cc:407] Connection header received
0805 22:53:33.400739 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.400745 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.400835 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.400952 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:33.401716 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.402545 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.405261 (+ 2716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.406734 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.406903 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.406977 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.407367 (+ 390us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.407517 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260805 22:53:33.407907 23106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.399087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37795 (local address 127.20.34.65:48647)
0805 22:53:33.400628 (+ 1541us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:33.400646 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:33.400787 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:33.401168 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:33.401176 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:33.401228 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:33.401618 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.401652 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.403092 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.403096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.405197 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.405222 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.406730 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.406784 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.407083 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.407122 (+ 39us) client_negotiation.cc:769] Sending connection context
0805 22:53:33.407312 (+ 190us) client_negotiation.cc:240] Negotiation successful
0805 22:53:33.407471 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1404,"spinlock_wait_cycles":1408,"thread_start_us":783,"threads_started":1}
I20260805 22:53:33.408708 23107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.398995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:42169 (local address 127.20.34.65:36729)
0805 22:53:33.400237 (+ 1242us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:33.400265 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:33.400531 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:33.400992 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:33.400997 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:33.401029 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:33.401481 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.401499 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.402708 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.402714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.405040 (+ 2326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.405057 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.406992 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.406999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.407161 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.407201 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:53:33.408201 (+ 1000us) client_negotiation.cc:240] Negotiation successful
0805 22:53:33.408375 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1003,"thread_start_us":1295,"threads_started":1}
I20260805 22:53:33.409118 22752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fe1aa6a07f40519224057279577ec1" candidate_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d879e25056c8444aa0eea6efddcdbc61" is_pre_election: true
I20260805 22:53:33.409448 22752 raft_consensus.cc:2454] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c08dd7d4e1b447b5b35fc9c831d01236 in term 0.
I20260805 22:53:33.409811 22960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fe1aa6a07f40519224057279577ec1" candidate_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b47a355470244cabddf2eadeb8a9357" is_pre_election: true
I20260805 22:53:33.409958 22435 leader_election.cc:302] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c08dd7d4e1b447b5b35fc9c831d01236, d879e25056c8444aa0eea6efddcdbc61; no voters:
I20260805 22:53:33.410290 22960 raft_consensus.cc:2454] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c08dd7d4e1b447b5b35fc9c831d01236 in term 0.
I20260805 22:53:33.410382 23068 raft_consensus.cc:2781] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:33.410532 23068 raft_consensus.cc:482] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:33.410635 23068 raft_consensus.cc:3037] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.413113 23068 raft_consensus.cc:504] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.413832 23068 leader_election.cc:288] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [CANDIDATE]: Term 1 election: Requested vote from peers d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795), 9b47a355470244cabddf2eadeb8a9357 (127.20.34.67:42169)
I20260805 22:53:33.414394 22752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fe1aa6a07f40519224057279577ec1" candidate_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d879e25056c8444aa0eea6efddcdbc61"
I20260805 22:53:33.414489 22960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fe1aa6a07f40519224057279577ec1" candidate_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b47a355470244cabddf2eadeb8a9357"
I20260805 22:53:33.414651 22752 raft_consensus.cc:3037] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.414722 22960 raft_consensus.cc:3037] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.417996 22752 raft_consensus.cc:2454] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c08dd7d4e1b447b5b35fc9c831d01236 in term 1.
I20260805 22:53:33.418622 22435 leader_election.cc:302] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c08dd7d4e1b447b5b35fc9c831d01236, d879e25056c8444aa0eea6efddcdbc61; no voters:
I20260805 22:53:33.418612 22960 raft_consensus.cc:2454] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c08dd7d4e1b447b5b35fc9c831d01236 in term 1.
I20260805 22:53:33.419028 23068 raft_consensus.cc:2781] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:33.419605 23068 raft_consensus.cc:686] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 LEADER]: Becoming Leader. State: Replica: c08dd7d4e1b447b5b35fc9c831d01236, State: Running, Role: LEADER
I20260805 22:53:33.420110 23068 consensus_queue.cc:237] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.424787 22309 catalog_manager.cc:5495] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 reported cstate change: term changed from 0 to 1, leader changed from <none> to c08dd7d4e1b447b5b35fc9c831d01236 (127.20.34.65). New cstate: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } health_report { overall_health: UNKNOWN } } }
W20260805 22:53:33.428910 22614 tablet.cc:2369] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 22:53:33 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970410, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:33.520196 23118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.502914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39151 (local address 127.0.0.1:57676)
0805 22:53:33.503609 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:33.503639 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:33.503828 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:33.504386 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:33.504390 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:33.505088 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:33.505293 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.505302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.506843 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.506848 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.508127 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.508143 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.509307 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.509319 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.509529 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.510381 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:33.510400 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:33.512983 (+ 2583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:33.517376 (+ 4393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:33.517390 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:33.517397 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:33.517858 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:33.518274 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:33.518280 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:33.518283 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:33.518419 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:33.518992 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:33.519000 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:33.519188 (+ 188us) client_negotiation.cc:769] Sending connection context
0805 22:53:33.519369 (+ 181us) client_negotiation.cc:240] Negotiation successful
0805 22:53:33.519684 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":346,"threads_started":1}
I20260805 22:53:33.520211 23119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.503002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57676 (local address 127.20.34.126:39151)
0805 22:53:33.503959 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.503966 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.503989 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:53:33.504052 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.504057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.504145 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.504328 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:33.505476 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.506651 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.508362 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.509042 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.509188 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.513252 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:33.513261 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:33.513266 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:33.513309 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:33.517181 (+ 3872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.518017 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.518028 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.518031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.518157 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.518549 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.518556 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.518559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.518846 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:33.519004 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.519462 (+ 458us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.519814 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":151,"server-negotiator.queue_time_us":816,"thread_start_us":678,"threads_started":1}
I20260805 22:53:33.526304 22309 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57676:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:53:33.527772 22309 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:33.536466 22502 tablet_service.cc:1467] Processing CreateTablet for tablet 94a1ff161cf548eca5a05c76b44b2ebf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fdbffdf4d9db40428aa85d0ac8111ab4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:53:33.536450 22718 tablet_service.cc:1467] Processing CreateTablet for tablet 94a1ff161cf548eca5a05c76b44b2ebf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fdbffdf4d9db40428aa85d0ac8111ab4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:53:33.536548 22926 tablet_service.cc:1467] Processing CreateTablet for tablet 94a1ff161cf548eca5a05c76b44b2ebf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fdbffdf4d9db40428aa85d0ac8111ab4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:53:33.537122 22718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94a1ff161cf548eca5a05c76b44b2ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:33.537127 22502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94a1ff161cf548eca5a05c76b44b2ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:33.537137 22926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94a1ff161cf548eca5a05c76b44b2ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:33.545804 23057 tablet_bootstrap.cc:492] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: Bootstrap starting.
I20260805 22:53:33.547451 23057 tablet_bootstrap.cc:654] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.548413 23061 tablet_bootstrap.cc:492] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: Bootstrap starting.
I20260805 22:53:33.548712 23060 tablet_bootstrap.cc:492] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: Bootstrap starting.
I20260805 22:53:33.550324 23061 tablet_bootstrap.cc:654] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.550652 23060 tablet_bootstrap.cc:654] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:33.554083 23060 tablet_bootstrap.cc:492] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: No bootstrap required, opened a new log
I20260805 22:53:33.554381 23060 ts_tablet_manager.cc:1397] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260805 22:53:33.555306 23060 raft_consensus.cc:348] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.555691 23060 raft_consensus.cc:374] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.555801 23060 raft_consensus.cc:729] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c08dd7d4e1b447b5b35fc9c831d01236, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.556140 23060 consensus_queue.cc:260] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.557390 23060 ts_tablet_manager.cc:1428] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:53:33.557175 23068 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.557612 23068 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:33.562134 23061 tablet_bootstrap.cc:492] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: No bootstrap required, opened a new log
I20260805 22:53:33.562381 23061 ts_tablet_manager.cc:1397] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.011s
I20260805 22:53:33.563505 23061 raft_consensus.cc:348] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.563804 23061 raft_consensus.cc:374] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.563907 23061 raft_consensus.cc:729] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d879e25056c8444aa0eea6efddcdbc61, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.564342 23061 consensus_queue.cc:260] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.564940 23066 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.565323 23066 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:33.565989 23061 ts_tablet_manager.cc:1428] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260805 22:53:33.568295 23057 tablet_bootstrap.cc:492] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: No bootstrap required, opened a new log
I20260805 22:53:33.568501 23057 ts_tablet_manager.cc:1397] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.009s
I20260805 22:53:33.569372 23057 raft_consensus.cc:348] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.569641 23057 raft_consensus.cc:374] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:33.569741 23057 raft_consensus.cc:729] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b47a355470244cabddf2eadeb8a9357, State: Initialized, Role: FOLLOWER
I20260805 22:53:33.570011 23057 consensus_queue.cc:260] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.570701 23065 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.570966 23057 ts_tablet_manager.cc:1428] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:53:33.571019 23065 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:33.575364 23068 raft_consensus.cc:482] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:33.575570 23068 raft_consensus.cc:504] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.576349 23068 leader_election.cc:288] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795), 9b47a355470244cabddf2eadeb8a9357 (127.20.34.67:42169)
I20260805 22:53:33.576895 22960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94a1ff161cf548eca5a05c76b44b2ebf" candidate_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b47a355470244cabddf2eadeb8a9357" is_pre_election: true
I20260805 22:53:33.576999 22752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94a1ff161cf548eca5a05c76b44b2ebf" candidate_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d879e25056c8444aa0eea6efddcdbc61" is_pre_election: true
I20260805 22:53:33.577210 22752 raft_consensus.cc:2454] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c08dd7d4e1b447b5b35fc9c831d01236 in term 0.
I20260805 22:53:33.577169 22960 raft_consensus.cc:2454] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c08dd7d4e1b447b5b35fc9c831d01236 in term 0.
I20260805 22:53:33.577579 22435 leader_election.cc:302] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c08dd7d4e1b447b5b35fc9c831d01236, d879e25056c8444aa0eea6efddcdbc61; no voters:
I20260805 22:53:33.577885 23068 raft_consensus.cc:2781] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:33.577991 23068 raft_consensus.cc:482] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:33.578137 23068 raft_consensus.cc:3037] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.580319 23068 raft_consensus.cc:504] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.580945 23068 leader_election.cc:288] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [CANDIDATE]: Term 1 election: Requested vote from peers d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795), 9b47a355470244cabddf2eadeb8a9357 (127.20.34.67:42169)
I20260805 22:53:33.581393 22752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94a1ff161cf548eca5a05c76b44b2ebf" candidate_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d879e25056c8444aa0eea6efddcdbc61"
I20260805 22:53:33.581542 22960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94a1ff161cf548eca5a05c76b44b2ebf" candidate_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b47a355470244cabddf2eadeb8a9357"
I20260805 22:53:33.581655 22752 raft_consensus.cc:3037] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.581784 22960 raft_consensus.cc:3037] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:33.584816 22752 raft_consensus.cc:2454] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c08dd7d4e1b447b5b35fc9c831d01236 in term 1.
I20260805 22:53:33.585414 22435 leader_election.cc:302] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c08dd7d4e1b447b5b35fc9c831d01236, d879e25056c8444aa0eea6efddcdbc61; no voters:
I20260805 22:53:33.585042 22960 raft_consensus.cc:2454] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c08dd7d4e1b447b5b35fc9c831d01236 in term 1.
I20260805 22:53:33.585744 23068 raft_consensus.cc:2781] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:33.585947 23068 raft_consensus.cc:686] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 LEADER]: Becoming Leader. State: Replica: c08dd7d4e1b447b5b35fc9c831d01236, State: Running, Role: LEADER
I20260805 22:53:33.586515 23068 consensus_queue.cc:237] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } }
I20260805 22:53:33.588577 23109 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: TxnStatusTablet state changed. Reason: New leader c08dd7d4e1b447b5b35fc9c831d01236. Latest consensus state: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.588920 23109 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:53:33.589708 23125 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:53:33.590024 23125 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:53:33.590461 22309 catalog_manager.cc:5495] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 reported cstate change: term changed from 0 to 1, leader changed from <none> to c08dd7d4e1b447b5b35fc9c831d01236 (127.20.34.65). New cstate: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } health_report { overall_health: UNKNOWN } } }
I20260805 22:53:33.627204 23118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.613913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34009 (local address 127.0.0.1:36282)
0805 22:53:33.614186 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:33.614210 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:33.614381 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:33.621342 (+ 6961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:33.621351 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:33.621370 (+ 19us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:53:33.621598 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.621610 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.623035 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.623044 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.624247 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.624262 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.625157 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.625164 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.625388 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.625457 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:53:33.626609 (+ 1152us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:53:33.626669 (+ 60us) client_negotiation.cc:769] Sending connection context
0805 22:53:33.626796 (+ 127us) client_negotiation.cc:240] Negotiation successful
0805 22:53:33.626961 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260805 22:53:33.628024 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.614338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36282 (local address 127.20.34.65:34009)
0805 22:53:33.620831 (+ 6493us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.620837 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.620864 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:53:33.620968 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.620972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.621072 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.621298 (+ 226us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:33.621781 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.622825 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.624467 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.624913 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.625171 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.625697 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:33.626479 (+ 782us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:33.626650 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.627556 (+ 906us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.627655 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6341,"thread_start_us":6121,"threads_started":1}
I20260805 22:53:33.632697 22752 raft_consensus.cc:1261] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Refusing update from remote peer c08dd7d4e1b447b5b35fc9c831d01236: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:33.633114 22960 raft_consensus.cc:1261] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Refusing update from remote peer c08dd7d4e1b447b5b35fc9c831d01236: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:33.633701 23109 consensus_queue.cc:1035] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:33.634039 23068 consensus_queue.cc:1035] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:33.639405 23066 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: TxnStatusTablet state changed. Reason: New leader c08dd7d4e1b447b5b35fc9c831d01236. Latest consensus state: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.639767 23066 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:33.641944 23109 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.642239 23109 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:53:33.642449 23078 mvcc.cc:205] Tried to move back new op lower bound from 7315334814231834624 to 7315334814053310464. Current Snapshot: MvccSnapshot[applied={T|T < 7315334814231834624}]
I20260805 22:53:33.651469 23082 mvcc.cc:205] Tried to move back new op lower bound from 7315334814231834624 to 7315334814053310464. Current Snapshot: MvccSnapshot[applied={T|T < 7315334814231834624 or (T in {7315334814231834624})}]
I20260805 22:53:33.652632 23065 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: TxnStatusTablet state changed. Reason: New leader c08dd7d4e1b447b5b35fc9c831d01236. Latest consensus state: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.652998 23065 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:33.655280 23068 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.655462 23066 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.655652 23068 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P c08dd7d4e1b447b5b35fc9c831d01236: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:53:33.655716 23066 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P d879e25056c8444aa0eea6efddcdbc61: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:33.672474 23065 tablet_replica.cc:439] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c08dd7d4e1b447b5b35fc9c831d01236" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34009 } } peers { permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 } } peers { permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 } } }
I20260805 22:53:33.672839 23065 tablet_replica.cc:442] T 94a1ff161cf548eca5a05c76b44b2ebf P 9b47a355470244cabddf2eadeb8a9357: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:33.675925 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.666575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36288 (local address 127.20.34.65:34009)
0805 22:53:33.666810 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.666816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.668239 (+ 1423us) server_negotiation.cc:407] Connection header received
0805 22:53:33.669170 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.669176 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.669273 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.669381 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:33.670165 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.671358 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.673538 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.674225 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.674318 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.674984 (+ 666us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:33.675123 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:33.675186 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.675478 (+ 292us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.675566 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 22:53:33.717036 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.710140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:38743 (local address 127.20.34.65:34009)
0805 22:53:33.710365 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.710373 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.711016 (+ 643us) server_negotiation.cc:407] Connection header received
0805 22:53:33.711279 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.711285 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.711367 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.711470 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:33.712057 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.713033 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.714780 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.715360 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.715492 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.716031 (+ 539us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:33.716195 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:33.716299 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.716443 (+ 144us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.716578 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":43}
I20260805 22:53:33.717104 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.709966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34009 (local address 127.20.34.65:38743)
0805 22:53:33.710896 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:33.710913 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:33.711112 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:33.711496 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:33.711500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:33.711514 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:53:33.711885 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.711894 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.713169 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.713177 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.714629 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:33.714642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.715593 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.715598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:33.715767 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.715836 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:53:33.716310 (+ 474us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:53:33.716322 (+ 12us) client_negotiation.cc:769] Sending connection context
0805 22:53:33.716424 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:53:33.716625 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":25,"thread_start_us":548,"threads_started":1}
I20260805 22:53:33.729849 22958 raft_consensus.cc:1261] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Refusing update from remote peer c08dd7d4e1b447b5b35fc9c831d01236: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:33.730124 22752 raft_consensus.cc:1261] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Refusing update from remote peer c08dd7d4e1b447b5b35fc9c831d01236: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:33.730512 23109 consensus_queue.cc:1035] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b47a355470244cabddf2eadeb8a9357" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:33.730784 23068 consensus_queue.cc:1035] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d879e25056c8444aa0eea6efddcdbc61" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:33.813280 22309 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:33.813578 22309 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:33.817235 22309 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9eff48aa754f480fbb0de299469f9244: Sending DeleteTablet for 3 replicas of tablet e3fe1aa6a07f40519224057279577ec1
I20260805 22:53:33.818318 22718 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fe1aa6a07f40519224057279577ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:33 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:41804
I20260805 22:53:33.818580 22926 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fe1aa6a07f40519224057279577ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:33 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:53794
I20260805 22:53:33.818852 22502 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fe1aa6a07f40519224057279577ec1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:33 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:36266
I20260805 22:53:33.825510 23153 tablet_replica.cc:330] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: stopping tablet replica
I20260805 22:53:33.826629 23155 tablet_replica.cc:330] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: stopping tablet replica
I20260805 22:53:33.827445 23153 raft_consensus.cc:2229] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:33.827751 23155 raft_consensus.cc:2229] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:53:33.828310 23153 raft_consensus.cc:2258] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:33.829285 23155 raft_consensus.cc:2258] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:33.831265 23153 ts_tablet_manager.cc:1905] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:33.832533 23155 ts_tablet_manager.cc:1905] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:33.834430 23154 tablet_replica.cc:330] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: stopping tablet replica
I20260805 22:53:33.834681 23154 raft_consensus.cc:2229] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:33.835007 23154 raft_consensus.cc:2258] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:33.836293 23154 ts_tablet_manager.cc:1905] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:33.844892 23154 ts_tablet_manager.cc:1918] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:33.845093 23154 log.cc:1196] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/e3fe1aa6a07f40519224057279577ec1
I20260805 22:53:33.845634 23154 ts_tablet_manager.cc:1939] T e3fe1aa6a07f40519224057279577ec1 P 9b47a355470244cabddf2eadeb8a9357: Deleting consensus metadata
I20260805 22:53:33.846941 22290 catalog_manager.cc:4841] TS 9b47a355470244cabddf2eadeb8a9357 (127.20.34.67:42169): tablet e3fe1aa6a07f40519224057279577ec1 (table test-table [id=ca55851bc96942f0a19fbf12466d34dc]) successfully deleted
I20260805 22:53:33.849493 23153 ts_tablet_manager.cc:1918] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:33.849663 23153 log.cc:1196] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/e3fe1aa6a07f40519224057279577ec1
I20260805 22:53:33.850303 23153 ts_tablet_manager.cc:1939] T e3fe1aa6a07f40519224057279577ec1 P d879e25056c8444aa0eea6efddcdbc61: Deleting consensus metadata
I20260805 22:53:33.850596 23155 ts_tablet_manager.cc:1918] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:33.850863 23155 log.cc:1196] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/e3fe1aa6a07f40519224057279577ec1
I20260805 22:53:33.851526 23155 ts_tablet_manager.cc:1939] T e3fe1aa6a07f40519224057279577ec1 P c08dd7d4e1b447b5b35fc9c831d01236: Deleting consensus metadata
I20260805 22:53:33.852910 22287 catalog_manager.cc:4841] TS c08dd7d4e1b447b5b35fc9c831d01236 (127.20.34.65:34009): tablet e3fe1aa6a07f40519224057279577ec1 (table test-table [id=ca55851bc96942f0a19fbf12466d34dc]) successfully deleted
I20260805 22:53:33.855041 22288 catalog_manager.cc:4841] TS d879e25056c8444aa0eea6efddcdbc61 (127.20.34.66:37795): tablet e3fe1aa6a07f40519224057279577ec1 (table test-table [id=ca55851bc96942f0a19fbf12466d34dc]) successfully deleted
Aug 05 22:53:33 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:33.864502 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.832841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36298 (local address 127.20.34.65:34009)
0805 22:53:33.833055 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.833062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.840575 (+ 7513us) server_negotiation.cc:407] Connection header received
0805 22:53:33.841284 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.841290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.841408 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.841507 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:33.843959 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.845163 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.847167 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.847975 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.848084 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.856781 (+ 8697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:33.856798 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:33.856815 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:33.856861 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:33.860850 (+ 3989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.861812 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.861821 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.861824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.862004 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.862494 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.862506 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.862510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.862963 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:33.863366 (+ 403us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.863748 (+ 382us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.864025 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260805 22:53:33.865403 22605 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36298
I20260805 22:53:33.890802 23119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.869437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.20.34.126:39151)
0805 22:53:33.869704 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.869712 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.875937 (+ 6225us) server_negotiation.cc:407] Connection header received
0805 22:53:33.876287 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.876292 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.876421 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.876546 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:33.878113 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.878988 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.880492 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.881026 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.881191 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.884080 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:33.884087 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:33.884091 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:33.884138 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:33.887437 (+ 3299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.888388 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.888396 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.888400 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.888562 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.889035 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.889039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.889041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.889377 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:33.889705 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.890102 (+ 397us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.890387 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260805 22:53:33.891542 22309 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57692
I20260805 22:53:33.894263 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22411
I20260805 22:53:33.911376 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.895871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36314 (local address 127.20.34.65:34009)
0805 22:53:33.896145 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.896179 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.896568 (+ 389us) server_negotiation.cc:407] Connection header received
0805 22:53:33.896806 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.896816 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.896904 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.897032 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:33.898346 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.899301 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.900806 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.901344 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.901516 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.904359 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:33.904366 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:33.904369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:33.904423 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:33.907712 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.908717 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.908724 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.908728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.908902 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.909598 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.909602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.909605 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.909989 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:33.910257 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.910748 (+ 491us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.910978 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260805 22:53:33.912339 22605 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36314
W20260805 22:53:33.912984 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22411: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:33.913224 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 22411
I20260805 22:53:33.944687 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22617
Aug 05 22:53:33 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:53:33.961467 23163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.945517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41816 (local address 127.20.34.66:37795)
0805 22:53:33.946078 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.946082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.946101 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:53:33.946158 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.946162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.946228 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.946346 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:33.947508 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.948518 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.949894 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.950449 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.950605 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:33.955011 (+ 4406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:33.955031 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:33.955050 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:33.955097 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:33.958266 (+ 3169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.959078 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.959087 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.959089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.959260 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:33.959650 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:33.959654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:33.959657 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:33.960109 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:33.960503 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:33.960844 (+ 341us) server_negotiation.cc:299] Negotiation successful
0805 22:53:33.961089 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":325,"threads_started":1}
W20260805 22:53:33.962380 22814 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41816
W20260805 22:53:33.963119 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22617: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:33.963287 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 22617
I20260805 22:53:33.988560 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22827
Aug 05 22:53:33 dist-test-slave-gmjp krb5kdc[22240](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970412, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:53:34.007946 23164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:33.989456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53808 (local address 127.20.34.67:42169)
0805 22:53:33.990025 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:33.990029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:33.990047 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:53:33.990115 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:33.990118 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:33.990179 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:33.990275 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:33.992073 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.992883 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.994881 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:33.995319 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:33.995433 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:34.001337 (+ 5904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:34.001355 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:34.001382 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:34.001426 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:34.004739 (+ 3313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:34.005609 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:34.005618 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:34.005620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:34.005767 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:34.006200 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:34.006207 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:34.006215 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:34.006631 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:34.006968 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:34.007312 (+ 344us) server_negotiation.cc:299] Negotiation successful
0805 22:53:34.007579 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":335,"threads_started":1}
W20260805 22:53:34.008800 23021 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53808
W20260805 22:53:34.009632 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22827: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:34.009821 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 22827
I20260805 22:53:34.042769 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22262
I20260805 22:53:34.044078 22367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:34.165764 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 22262
2026-08-05T22:53:34Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5212 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:34 dist-test-slave-gmjp krb5kdc[23171](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:34 dist-test-slave-gmjp krb5kdc[23171](info): set up 2 sockets
Aug 05 22:53:34 dist-test-slave-gmjp krb5kdc[23171](info): commencing operation
krb5kdc: starting...
W20260805 22:53:35.488847 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.007s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:53:35 dist-test-slave-gmjp krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:53:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:53:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:53:35.760116 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:36211
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:42891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:36211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:36.113505 23189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:36.113921 23189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:36.114099 23189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:36.121753 23189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:53:36.121946 23189 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:53:36.122054 23189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:36.122177 23189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:36.122282 23189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:53:36.122382 23189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:53:36.132665 23189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:36211
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:36211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:36.134122 23189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:36.135506 23189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:36.148213 23195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:36.148296 23196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:36.148330 23200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:36.149187 23189 server_base.cc:1034] running on GCE node
I20260805 22:53:36.150041 23189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:36.151649 23189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:36.152923 23189 hybrid_clock.cc:648] HybridClock initialized: now 1785970416152839 us; error 59 us; skew 500 ppm
I20260805 22:53:36.153307 23189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:36 dist-test-slave-gmjp krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970416, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:36.156867 23189 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:53:36.158600 23189 webserver.cc:460] Webserver started at http://127.20.34.126:33195/ using document root <none> and password file <none>
I20260805 22:53:36.159348 23189 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:36.159441 23189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:36.159721 23189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:36.163094 23189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "86a1eb19ea124f859e3cf1c119c4ce37"
format_stamp: "Formatted at 2026-08-05 22:53:36 on dist-test-slave-gmjp"
server_key: "aada380eefa00e90c65d5060c4a5adc2"
server_key_iv: "9c0988034bc8b6a7352f26e6fda37ff1"
server_key_version: "encryptionkey@0"
I20260805 22:53:36.163904 23189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "86a1eb19ea124f859e3cf1c119c4ce37"
format_stamp: "Formatted at 2026-08-05 22:53:36 on dist-test-slave-gmjp"
server_key: "aada380eefa00e90c65d5060c4a5adc2"
server_key_iv: "9c0988034bc8b6a7352f26e6fda37ff1"
server_key_version: "encryptionkey@0"
I20260805 22:53:36.169780 23189 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260805 22:53:36.173982 23208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:36.175581 23189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:53:36.175791 23189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "86a1eb19ea124f859e3cf1c119c4ce37"
format_stamp: "Formatted at 2026-08-05 22:53:36 on dist-test-slave-gmjp"
server_key: "aada380eefa00e90c65d5060c4a5adc2"
server_key_iv: "9c0988034bc8b6a7352f26e6fda37ff1"
server_key_version: "encryptionkey@0"
I20260805 22:53:36.176059 23189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:36.191676 23189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:36.196445 23189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:36.196768 23189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:36.221063 23189 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:36211
I20260805 22:53:36.221108 23311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:36211 every 8 connection(s)
I20260805 22:53:36.222577 23189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:53:36.226521 23312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:36.226521 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 23189
I20260805 22:53:36.226774 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:53:36.227501 20617 external_mini_cluster.cc:1428] Setting key 80f01224c58a24baec777a4aee8f87e8
I20260805 22:53:36.241976 23312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: Bootstrap starting.
Aug 05 22:53:36 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:36.245931 23312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:36.247584 23312 log.cc:824] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:36.251348 23312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: No bootstrap required, opened a new log
I20260805 22:53:36.254657 23317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:36.229847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36908 (local address 127.20.34.126:36211)
0805 22:53:36.230694 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:36.230706 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:36.230750 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:53:36.233070 (+ 2320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:36.233099 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:36.233541 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:36.233881 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:36.235807 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.237173 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.239073 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.239921 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.240120 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:36.245208 (+ 5088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:36.245218 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:36.245235 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:36.245286 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:36.249195 (+ 3909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:36.250028 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:36.250040 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:36.250050 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:36.250292 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:36.250688 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:36.250693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:36.250696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:36.251490 (+ 794us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:36.251827 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:36.252355 (+ 528us) server_negotiation.cc:299] Negotiation successful
0805 22:53:36.252870 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":392,"threads_started":1}
I20260805 22:53:36.261507 23312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a1eb19ea124f859e3cf1c119c4ce37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36211 } }
I20260805 22:53:36.261922 23312 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:36.261996 23312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86a1eb19ea124f859e3cf1c119c4ce37, State: Initialized, Role: FOLLOWER
I20260805 22:53:36.262547 23312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a1eb19ea124f859e3cf1c119c4ce37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36211 } }
I20260805 22:53:36.262830 23312 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:53:36.262941 23312 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:53:36.263069 23312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:36.265556 23312 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a1eb19ea124f859e3cf1c119c4ce37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36211 } }
I20260805 22:53:36.266175 23312 leader_election.cc:302] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86a1eb19ea124f859e3cf1c119c4ce37; no voters:
I20260805 22:53:36.266749 23312 leader_election.cc:288] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:53:36.266914 23319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:36.267649 23319 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [term 1 LEADER]: Becoming Leader. State: Replica: 86a1eb19ea124f859e3cf1c119c4ce37, State: Running, Role: LEADER
I20260805 22:53:36.268318 23319 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a1eb19ea124f859e3cf1c119c4ce37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36211 } }
I20260805 22:53:36.269134 23312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:53:36.271685 23320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86a1eb19ea124f859e3cf1c119c4ce37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a1eb19ea124f859e3cf1c119c4ce37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36211 } } }
I20260805 22:53:36.274374 23320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:36.273403 23321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86a1eb19ea124f859e3cf1c119c4ce37. Latest consensus state: current_term: 1 leader_uuid: "86a1eb19ea124f859e3cf1c119c4ce37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a1eb19ea124f859e3cf1c119c4ce37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36211 } } }
I20260805 22:53:36.275355 23321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:36.276821 23331 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:53:36.283174 23331 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:53:36.294409 23331 catalog_manager.cc:1347] Generated new cluster ID: 76b6d7b21c6347e282093838b80292c4
I20260805 22:53:36.294552 23331 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:53:36.306725 23331 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:53:36.308923 23331 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:53:36.320093 23331 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: Generated new TSK 0
I20260805 22:53:36.321331 23331 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:53:36.377830 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36211
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:42891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:36.741658 23348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:36.741963 23348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:36.742161 23348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:36.749590 23348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:36.749734 23348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:36.749953 23348 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:53:36.750036 23348 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:53:36.750173 23348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:53:36.760699 23348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:36211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:36.762149 23348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:36.763564 23348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:36.778003 23353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:36.777966 23354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:36.779240 23358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:36.780484 23348 server_base.cc:1034] running on GCE node
I20260805 22:53:36.781353 23348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:36.782577 23348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:36.783843 23348 hybrid_clock.cc:648] HybridClock initialized: now 1785970416783797 us; error 48 us; skew 500 ppm
I20260805 22:53:36.784315 23348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:36 dist-test-slave-gmjp krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970416, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:36.787915 23348 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:53:36.789728 23348 webserver.cc:460] Webserver started at http://127.20.34.65:38643/ using document root <none> and password file <none>
I20260805 22:53:36.790568 23348 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:36.790741 23348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:36.791117 23348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:36.794660 23348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "365826d6f290474f94ac48519b82af4d"
format_stamp: "Formatted at 2026-08-05 22:53:36 on dist-test-slave-gmjp"
server_key: "97160fdbf5df9bf2a40f782320b7effd"
server_key_iv: "10bee9eda0da84bdb7c926b3acd8285e"
server_key_version: "encryptionkey@0"
I20260805 22:53:36.795552 23348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "365826d6f290474f94ac48519b82af4d"
format_stamp: "Formatted at 2026-08-05 22:53:36 on dist-test-slave-gmjp"
server_key: "97160fdbf5df9bf2a40f782320b7effd"
server_key_iv: "10bee9eda0da84bdb7c926b3acd8285e"
server_key_version: "encryptionkey@0"
I20260805 22:53:36.801683 23348 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 22:53:36.806090 23369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:36.807659 23348 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:53:36.807891 23348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "365826d6f290474f94ac48519b82af4d"
format_stamp: "Formatted at 2026-08-05 22:53:36 on dist-test-slave-gmjp"
server_key: "97160fdbf5df9bf2a40f782320b7effd"
server_key_iv: "10bee9eda0da84bdb7c926b3acd8285e"
server_key_version: "encryptionkey@0"
I20260805 22:53:36.808148 23348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:36.831939 23348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:36.836715 23348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:36.837064 23348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:36.840005 23348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:36.840183 23348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:36.840342 23348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:36.840443 23348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:53:36 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970416, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:36.866592 23383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:36.840973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:45531 (local address 127.20.34.126:36211)
0805 22:53:36.841640 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:36.841649 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:36.842903 (+ 1254us) server_negotiation.cc:407] Connection header received
0805 22:53:36.846316 (+ 3413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:36.846325 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:36.846444 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:36.846583 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:36.849110 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.850069 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.851718 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.852204 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.852362 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:36.858222 (+ 5860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:36.858233 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:36.858241 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:36.858298 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:36.862139 (+ 3841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:36.863547 (+ 1408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:36.863556 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:36.863562 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:36.863755 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:36.864602 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:36.864607 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:36.864611 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:36.864917 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:36.865092 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:36.865936 (+ 844us) server_negotiation.cc:299] Negotiation successful
0805 22:53:36.866201 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":265,"threads_started":1}
I20260805 22:53:36.867681 23384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:36.841710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36211 (local address 127.20.34.65:45531)
0805 22:53:36.842683 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:36.842742 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:36.845867 (+ 3125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:36.846886 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:36.846895 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:36.847828 (+ 933us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:36.848907 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:36.848939 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.850225 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.850235 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:36.851568 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:36.851580 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.852657 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.852670 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:36.853125 (+ 455us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:36.854147 (+ 1022us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:36.854203 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:36.857813 (+ 3610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:36.862347 (+ 4534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:36.862356 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:36.862381 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:36.863341 (+ 960us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:36.863986 (+ 645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:36.863991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:36.863998 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:36.864401 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:36.865065 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:36.865074 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:36.865511 (+ 437us) client_negotiation.cc:769] Sending connection context
0805 22:53:36.865809 (+ 298us) client_negotiation.cc:240] Negotiation successful
0805 22:53:36.866421 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":371,"threads_started":1}
I20260805 22:53:36.891048 23469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:36.874486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36211 (local address 127.20.34.65:57295)
0805 22:53:36.875203 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:36.875227 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:36.875430 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:36.875822 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:36.875827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:36.876704 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:36.877320 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:36.877334 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.878937 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.878944 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:36.880921 (+ 1977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:36.880937 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.881763 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.881769 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:36.881960 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:36.882655 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:36.882674 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:36.883518 (+ 844us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:36.887559 (+ 4041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:36.887565 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:36.887570 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:36.888512 (+ 942us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:36.889032 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:36.889042 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:36.889045 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:36.889303 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:36.890074 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:36.890077 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:36.890262 (+ 185us) client_negotiation.cc:769] Sending connection context
0805 22:53:36.890388 (+ 126us) client_negotiation.cc:240] Negotiation successful
0805 22:53:36.890674 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":420,"threads_started":1}
I20260805 22:53:36.891309 23383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:36.874389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:57295 (local address 127.20.34.126:36211)
0805 22:53:36.874581 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:36.874585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:36.875339 (+ 754us) server_negotiation.cc:407] Connection header received
0805 22:53:36.875588 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:36.875595 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:36.875678 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:36.875785 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:36.877495 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.878613 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.881076 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:36.881556 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:36.881712 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:36.883731 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:36.883742 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:36.883746 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:36.883780 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:36.887345 (+ 3565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:36.888691 (+ 1346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:36.888699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:36.888706 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:36.888888 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:36.889474 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:36.889481 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:36.889487 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:36.889944 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:36.890115 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:36.890582 (+ 467us) server_negotiation.cc:299] Negotiation successful
0805 22:53:36.890880 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 22:53:36.902947 23348 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:45829
I20260805 22:53:36.903009 23541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:45829 every 8 connection(s)
I20260805 22:53:36.904496 23348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:53:36.905246 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 23348
I20260805 22:53:36.905489 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:53:36.906402 20617 external_mini_cluster.cc:1428] Setting key bd3c25f1dff5b1d88e2552090a9dc5d7
I20260805 22:53:36.907454 23542 heartbeater.cc:347] Connected to a master server at 127.20.34.126:36211
I20260805 22:53:36.907764 23542 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:36.908756 23542 heartbeater.cc:511] Master 127.20.34.126:36211 requested a full tablet report, sending...
I20260805 22:53:36.911329 23235 ts_manager.cc:194] Registered new tserver with Master: 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829)
I20260805 22:53:36.913643 23235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:45531
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:53:36.961843 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36211
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:42891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:37.323426 23549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:37.323746 23549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:37.323868 23549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:37.331501 23549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:37.331624 23549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:37.331712 23549 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:53:37.331772 23549 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:53:37.331845 23549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:53:37.342449 23549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:36211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:37.344040 23549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:37.345542 23549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:37.359714 23557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:37.359834 23560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:37.359874 23558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:37.360884 23549 server_base.cc:1034] running on GCE node
I20260805 22:53:37.361496 23549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:37.362426 23549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:37.363636 23549 hybrid_clock.cc:648] HybridClock initialized: now 1785970417363586 us; error 36 us; skew 500 ppm
I20260805 22:53:37.363979 23549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:37 dist-test-slave-gmjp krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970417, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:37.370976 23549 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:53:37.372772 23549 webserver.cc:460] Webserver started at http://127.20.34.66:41941/ using document root <none> and password file <none>
I20260805 22:53:37.373569 23549 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:37.373733 23549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:37.374084 23549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:37.377583 23549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "af4ad0071d504bc188a7f9f71417dc65"
format_stamp: "Formatted at 2026-08-05 22:53:37 on dist-test-slave-gmjp"
server_key: "815784d1248a67ec2715e0a649820690"
server_key_iv: "fbbea1f6c21dff1d50c23f8508f62c34"
server_key_version: "encryptionkey@0"
I20260805 22:53:37.378432 23549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "af4ad0071d504bc188a7f9f71417dc65"
format_stamp: "Formatted at 2026-08-05 22:53:37 on dist-test-slave-gmjp"
server_key: "815784d1248a67ec2715e0a649820690"
server_key_iv: "fbbea1f6c21dff1d50c23f8508f62c34"
server_key_version: "encryptionkey@0"
I20260805 22:53:37.384724 23549 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 22:53:37.388674 23568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:37.390290 23549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:53:37.390516 23549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "af4ad0071d504bc188a7f9f71417dc65"
format_stamp: "Formatted at 2026-08-05 22:53:37 on dist-test-slave-gmjp"
server_key: "815784d1248a67ec2715e0a649820690"
server_key_iv: "fbbea1f6c21dff1d50c23f8508f62c34"
server_key_version: "encryptionkey@0"
I20260805 22:53:37.390769 23549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:37.439893 23549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:37.444774 23549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:37.445123 23549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:37.448004 23549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:37.448179 23549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:37.448374 23549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:37.448477 23549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:53:37 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970417, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:37.478344 23584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:37.448974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:46119 (local address 127.20.34.126:36211)
0805 22:53:37.449556 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:37.449565 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:37.450885 (+ 1320us) server_negotiation.cc:407] Connection header received
0805 22:53:37.453675 (+ 2790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:37.453681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:37.453768 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:37.453841 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:37.456697 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:37.457909 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:37.461379 (+ 3470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:37.461962 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:37.462119 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:37.468708 (+ 6589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:37.468722 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:37.468730 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:37.468799 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:37.473240 (+ 4441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:37.474691 (+ 1451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:37.474699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:37.474703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:37.474932 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:37.475772 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:37.475780 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:37.475795 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:37.476250 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:37.476467 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:37.477691 (+ 1224us) server_negotiation.cc:299] Negotiation successful
0805 22:53:37.477951 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":306,"threads_started":1}
I20260805 22:53:37.479538 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:37.449707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36211 (local address 127.20.34.66:46119)
0805 22:53:37.450646 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:37.450708 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:37.453215 (+ 2507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:37.454460 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:37.454469 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:37.455439 (+ 970us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:37.456487 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:37.456513 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:37.458142 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:37.458148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:37.461154 (+ 3006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:37.461177 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:37.462493 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:37.462504 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:37.462894 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:37.463884 (+ 990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:37.463930 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:37.468263 (+ 4333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:37.473448 (+ 5185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:37.473463 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:37.473487 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:37.474453 (+ 966us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:37.475096 (+ 643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:37.475104 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:37.475111 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:37.475535 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:37.476463 (+ 928us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:37.476479 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:37.477256 (+ 777us) client_negotiation.cc:769] Sending connection context
0805 22:53:37.477566 (+ 310us) client_negotiation.cc:240] Negotiation successful
0805 22:53:37.478189 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":395,"threads_started":1}
I20260805 22:53:37.498405 23549 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:44755
I20260805 22:53:37.498430 23755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:44755 every 8 connection(s)
I20260805 22:53:37.500296 23549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:53:37.502692 23756 heartbeater.cc:347] Connected to a master server at 127.20.34.126:36211
I20260805 22:53:37.502991 23756 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:37.503738 23756 heartbeater.cc:511] Master 127.20.34.126:36211 requested a full tablet report, sending...
I20260805 22:53:37.505474 23715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:37.487437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36211 (local address 127.20.34.66:60077)
0805 22:53:37.488430 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:37.488459 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:37.488664 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:37.489083 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:37.489090 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:37.489654 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:37.490096 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:37.490119 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:37.491878 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:37.491890 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:37.494413 (+ 2523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:37.494434 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:37.495986 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:37.496001 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:37.496230 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:37.496927 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:37.496956 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:37.498367 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:37.502475 (+ 4108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:37.502484 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:37.502491 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:37.503129 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:37.503553 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:37.503558 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:37.503562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:37.503711 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:37.504420 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:37.504425 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:37.504630 (+ 205us) client_negotiation.cc:769] Sending connection context
0805 22:53:37.504796 (+ 166us) client_negotiation.cc:240] Negotiation successful
0805 22:53:37.505156 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"thread_start_us":529,"threads_started":1}
I20260805 22:53:37.505456 23235 ts_manager.cc:194] Registered new tserver with Master: af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755)
I20260805 22:53:37.505548 23584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:37.486996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:60077 (local address 127.20.34.126:36211)
0805 22:53:37.487268 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:37.487276 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:37.488593 (+ 1317us) server_negotiation.cc:407] Connection header received
0805 22:53:37.488818 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:37.488823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:37.488926 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:37.489044 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:37.490318 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:37.491665 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:37.494646 (+ 2981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:37.495473 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:37.495629 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:37.498649 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:37.498661 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:37.498667 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:37.498716 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:37.502298 (+ 3582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:37.503273 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:37.503279 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:37.503283 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:37.503430 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:37.503839 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:37.503844 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:37.503848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:37.504287 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:37.504470 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:37.504949 (+ 479us) server_negotiation.cc:299] Negotiation successful
0805 22:53:37.505207 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:53:37.506623 23235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:46119
I20260805 22:53:37.510218 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 23549
I20260805 22:53:37.510426 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:53:37.510905 20617 external_mini_cluster.cc:1428] Setting key ab7daefb0ea04dc60d3fca8c63a82cba
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:53:37.567308 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:36211
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:42891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:53:37.916992 23542 heartbeater.cc:503] Master 127.20.34.126:36211 was elected leader, sending a full tablet report...
W20260805 22:53:37.924371 23760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:37.924741 23760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:37.924927 23760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:37.932744 23760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:37.932905 23760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:37.933060 23760 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 22:53:37.933149 23760 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:53:37.933291 23760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:53:37.943845 23760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:36211
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:37.945477 23760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:37.946938 23760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:37.961416 23767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:37.961391 23766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:37.961462 23770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:37.962234 23760 server_base.cc:1034] running on GCE node
I20260805 22:53:37.962954 23760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:37.963954 23760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:37.965237 23760 hybrid_clock.cc:648] HybridClock initialized: now 1785970417965177 us; error 53 us; skew 500 ppm
I20260805 22:53:37.965649 23760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:37 dist-test-slave-gmjp krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970417, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:37.969329 23760 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:53:37.971154 23760 webserver.cc:460] Webserver started at http://127.20.34.67:45651/ using document root <none> and password file <none>
I20260805 22:53:37.971961 23760 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:37.972091 23760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:37.972515 23760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:37.975951 23760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "39f28b80f8974907962364f80b2b59e8"
format_stamp: "Formatted at 2026-08-05 22:53:37 on dist-test-slave-gmjp"
server_key: "d1785f2ddb42c65a165744b0d31b00dc"
server_key_iv: "e7218344d79a8ba877d62a234d5ab43f"
server_key_version: "encryptionkey@0"
I20260805 22:53:37.976912 23760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "39f28b80f8974907962364f80b2b59e8"
format_stamp: "Formatted at 2026-08-05 22:53:37 on dist-test-slave-gmjp"
server_key: "d1785f2ddb42c65a165744b0d31b00dc"
server_key_iv: "e7218344d79a8ba877d62a234d5ab43f"
server_key_version: "encryptionkey@0"
I20260805 22:53:37.983287 23760 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260805 22:53:37.987326 23781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:37.988878 23760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 22:53:37.989035 23760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "39f28b80f8974907962364f80b2b59e8"
format_stamp: "Formatted at 2026-08-05 22:53:37 on dist-test-slave-gmjp"
server_key: "d1785f2ddb42c65a165744b0d31b00dc"
server_key_iv: "e7218344d79a8ba877d62a234d5ab43f"
server_key_version: "encryptionkey@0"
I20260805 22:53:37.989223 23760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:38.001255 23760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:38.005834 23760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:38.006202 23760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:38.009356 23760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:38.009505 23760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:38.009675 23760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:38.009810 23760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:53:38 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970417, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:38.037848 23793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.009654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:44557 (local address 127.20.34.126:36211)
0805 22:53:38.010754 (+ 1100us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.010761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.011658 (+ 897us) server_negotiation.cc:407] Connection header received
0805 22:53:38.015030 (+ 3372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.015036 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.015140 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.015250 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:38.018698 (+ 3448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.019731 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.023747 (+ 4016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.024529 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.024692 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.030287 (+ 5595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:38.030293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:38.030297 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:38.030334 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:38.033389 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:38.034581 (+ 1192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:38.034586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:38.034588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:38.034733 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:38.035487 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:38.035492 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:38.035494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:38.035799 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:38.035935 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.037334 (+ 1399us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.037548 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":919,"thread_start_us":726,"threads_started":1}
I20260805 22:53:38.040126 23795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.010326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36211 (local address 127.20.34.67:44557)
0805 22:53:38.011443 (+ 1117us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.011505 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.014577 (+ 3072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.015608 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.015622 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.016767 (+ 1145us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:38.018366 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.018426 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.019984 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.019999 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.023431 (+ 3432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.023454 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.025120 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.025133 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.025488 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.026486 (+ 998us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:38.026512 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:38.029988 (+ 3476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:38.033571 (+ 3583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:38.033584 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:38.033604 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:38.034375 (+ 771us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:38.034895 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:38.034904 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:38.034912 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:38.035311 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:38.035975 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:38.035993 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:38.036711 (+ 718us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.037195 (+ 484us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.038050 (+ 855us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"thread_start_us":502,"threads_started":1}
I20260805 22:53:38.072495 23880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.047167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36211 (local address 127.20.34.67:39321)
0805 22:53:38.056830 (+ 9663us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.056858 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.057105 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.057545 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.057550 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.058066 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:38.058370 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.058380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.059461 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.059467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.060678 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.060703 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.061814 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.061819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.061955 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.062674 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:38.062706 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:38.063984 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:38.068913 (+ 4929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:38.068925 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:38.068928 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:38.069525 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:38.070049 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:38.070058 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:38.070063 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:38.070306 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:38.071192 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:38.071198 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:38.071428 (+ 230us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.071562 (+ 134us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.071885 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9464,"thread_start_us":9260,"threads_started":1}
I20260805 22:53:38.072520 23793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.047162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:39321 (local address 127.20.34.126:36211)
0805 22:53:38.047384 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.047392 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.057024 (+ 9632us) server_negotiation.cc:407] Connection header received
0805 22:53:38.057290 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.057294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.057392 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.057508 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:38.058556 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.059305 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.060879 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.061612 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.061778 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.064284 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:38.064295 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:38.064303 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:38.064357 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:38.068721 (+ 4364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:38.069664 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:38.069673 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:38.069679 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:38.069866 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:38.070567 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:38.070571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:38.070575 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:38.071027 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:38.071214 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.071750 (+ 536us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.072053 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:53:38.077461 23760 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:34347
I20260805 22:53:38.077497 23952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:34347 every 8 connection(s)
I20260805 22:53:38.079012 23760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:53:38.081398 23953 heartbeater.cc:347] Connected to a master server at 127.20.34.126:36211
I20260805 22:53:38.081683 23953 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:38.082509 23953 heartbeater.cc:511] Master 127.20.34.126:36211 requested a full tablet report, sending...
I20260805 22:53:38.084306 23235 ts_manager.cc:194] Registered new tserver with Master: 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347)
I20260805 22:53:38.085057 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 23760
I20260805 22:53:38.085248 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:53:38.085368 23235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:44557
I20260805 22:53:38.085791 20617 external_mini_cluster.cc:1428] Setting key fb527507f168ec703c7d6e9af9312af6
I20260805 22:53:38.089480 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:53:38 dist-test-slave-gmjp krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:53:38 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:38.150290 23793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.135560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36910 (local address 127.20.34.126:36211)
0805 22:53:38.135838 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.135845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.136109 (+ 264us) server_negotiation.cc:407] Connection header received
0805 22:53:38.136420 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.136425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.136498 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.136613 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:38.138107 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.138869 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.140187 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.140632 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.140774 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.144968 (+ 4194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:38.144973 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:38.144977 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:38.145016 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:38.147557 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:38.148257 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:38.148263 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:38.148267 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:38.148401 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:38.148803 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:38.148807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:38.148809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:38.149082 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:38.149375 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.149672 (+ 297us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.149927 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260805 22:53:38.154922 23235 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:53:38.162118 23235 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:38.187016 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.176341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57742 (local address 127.20.34.66:44755)
0805 22:53:38.176985 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.176999 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.177771 (+ 772us) server_negotiation.cc:407] Connection header received
0805 22:53:38.177879 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.177885 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.178062 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.178266 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:38.179021 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.181048 (+ 2027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.184180 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.185759 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.185928 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.186188 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.186520 (+ 332us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.186699 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":323,"threads_started":1}
I20260805 22:53:38.187069 23981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.175752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:44755 (local address 127.0.0.1:57742)
0805 22:53:38.177510 (+ 1758us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.177530 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.177648 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.178266 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.178274 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.178312 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:38.178812 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.178829 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.181358 (+ 2529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.181365 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.183929 (+ 2564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.183950 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.185989 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.185995 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.186227 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.186290 (+ 63us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.186463 (+ 173us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.186679 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1601,"thread_start_us":1442,"threads_started":1}
I20260805 22:53:38.188190 23974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.175246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45829 (local address 127.0.0.1:48512)
0805 22:53:38.176170 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.176215 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.176388 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.180511 (+ 4123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.180519 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.180582 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:38.181069 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.181085 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.182981 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.182987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.185237 (+ 2250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.185250 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.187237 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.187245 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.187417 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.187457 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.187526 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.187665 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":117,"thread_start_us":699,"threads_started":1}
I20260805 22:53:38.188793 23983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.176955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34347 (local address 127.0.0.1:54078)
0805 22:53:38.179551 (+ 2596us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.179569 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.179751 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.180803 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.180810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.180842 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:38.181401 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.181415 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.183160 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.183165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.185577 (+ 2412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.185592 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.187873 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.187879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.188072 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.188117 (+ 45us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.188256 (+ 139us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.188401 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2475,"mutex_wait_us":32,"thread_start_us":2349,"threads_started":1}
I20260805 22:53:38.189250 23977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.175391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48512 (local address 127.20.34.65:45829)
0805 22:53:38.179939 (+ 4548us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.179946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.179974 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:53:38.180083 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.180090 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.180296 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.181060 (+ 764us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:38.181300 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.182833 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.185426 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.186960 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.188442 (+ 1482us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.188664 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.188765 (+ 101us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.188958 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4402,"thread_start_us":4255,"threads_started":1}
I20260805 22:53:38.190560 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.177273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54078 (local address 127.20.34.67:34347)
0805 22:53:38.179112 (+ 1839us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.179123 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.179656 (+ 533us) server_negotiation.cc:407] Connection header received
0805 22:53:38.179970 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.179977 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.180254 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.180459 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:38.181737 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.183006 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.185778 (+ 2772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.187340 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.187467 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.187716 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.189145 (+ 1429us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.189348 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1604,"thread_start_us":1370,"threads_started":1}
I20260805 22:53:38.191264 23644 tablet_service.cc:1467] Processing CreateTablet for tablet cb665918309746a798ab972a645ac2fc (DEFAULT_TABLE table=test-table [id=4d6fbca84a7a4f1d8c61ce4877538a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:38.192957 23644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb665918309746a798ab972a645ac2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.192813 23444 tablet_service.cc:1467] Processing CreateTablet for tablet cb665918309746a798ab972a645ac2fc (DEFAULT_TABLE table=test-table [id=4d6fbca84a7a4f1d8c61ce4877538a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:38.194263 23444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb665918309746a798ab972a645ac2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.194231 23851 tablet_service.cc:1467] Processing CreateTablet for tablet cb665918309746a798ab972a645ac2fc (DEFAULT_TABLE table=test-table [id=4d6fbca84a7a4f1d8c61ce4877538a47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:38.195670 23851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb665918309746a798ab972a645ac2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.208442 23985 tablet_bootstrap.cc:492] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Bootstrap starting.
I20260805 22:53:38.210105 23987 tablet_bootstrap.cc:492] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Bootstrap starting.
I20260805 22:53:38.211934 23988 tablet_bootstrap.cc:492] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Bootstrap starting.
I20260805 22:53:38.213338 23985 tablet_bootstrap.cc:654] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.214058 23987 tablet_bootstrap.cc:654] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.214769 23985 log.cc:824] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:38.215107 23988 tablet_bootstrap.cc:654] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.215324 23987 log.cc:824] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:38.216390 23988 log.cc:824] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:38.218092 23985 tablet_bootstrap.cc:492] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: No bootstrap required, opened a new log
I20260805 22:53:38.218418 23985 ts_tablet_manager.cc:1397] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260805 22:53:38.219556 23988 tablet_bootstrap.cc:492] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: No bootstrap required, opened a new log
I20260805 22:53:38.219843 23988 ts_tablet_manager.cc:1397] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260805 22:53:38.225589 23987 tablet_bootstrap.cc:492] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: No bootstrap required, opened a new log
I20260805 22:53:38.225899 23987 ts_tablet_manager.cc:1397] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.000s
I20260805 22:53:38.229876 23985 raft_consensus.cc:348] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.230399 23985 raft_consensus.cc:374] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.230509 23985 raft_consensus.cc:729] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365826d6f290474f94ac48519b82af4d, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.230931 23988 raft_consensus.cc:348] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.231361 23988 raft_consensus.cc:374] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.231477 23988 raft_consensus.cc:729] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39f28b80f8974907962364f80b2b59e8, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.231361 23985 consensus_queue.cc:260] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.232100 23988 consensus_queue.cc:260] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.237522 23987 raft_consensus.cc:348] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.237960 23987 raft_consensus.cc:374] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.238063 23987 raft_consensus.cc:729] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4ad0071d504bc188a7f9f71417dc65, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.238694 23987 consensus_queue.cc:260] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.240136 23985 ts_tablet_manager.cc:1428] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Time spent starting tablet: real 0.022s user 0.022s sys 0.000s
I20260805 22:53:38.247308 23953 heartbeater.cc:503] Master 127.20.34.126:36211 was elected leader, sending a full tablet report...
I20260805 22:53:38.247496 23756 heartbeater.cc:503] Master 127.20.34.126:36211 was elected leader, sending a full tablet report...
I20260805 22:53:38.247968 23988 ts_tablet_manager.cc:1428] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Time spent starting tablet: real 0.028s user 0.012s sys 0.016s
I20260805 22:53:38.248353 23987 ts_tablet_manager.cc:1428] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Time spent starting tablet: real 0.022s user 0.012s sys 0.009s
W20260805 22:53:38.252578 23757 tablet.cc:2369] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:53:38.331019 23954 tablet.cc:2369] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:53:38.369546 23996 raft_consensus.cc:482] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:38.370097 23996 raft_consensus.cc:504] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.372277 23996 leader_election.cc:288] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347)
I20260805 22:53:38.379467 23977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.372649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:50851 (local address 127.20.34.65:45829)
0805 22:53:38.372913 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.372924 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.373367 (+ 443us) server_negotiation.cc:407] Connection header received
0805 22:53:38.373641 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.373651 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.373769 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.373870 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:38.374543 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.375500 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.377669 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.378470 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.378677 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.378762 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.379068 (+ 306us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.379203 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:53:38.379657 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.372599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45829 (local address 127.20.34.66:50851)
0805 22:53:38.373237 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.373258 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.373447 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.373990 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.373998 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.374029 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:38.374393 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.374402 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.375674 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.375679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.377498 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.377512 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.378720 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.378727 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.378891 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.378921 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.379038 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.379182 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":1,"thread_start_us":362,"threads_started":1}
I20260805 22:53:38.379722 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.373686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:58197 (local address 127.20.34.67:34347)
0805 22:53:38.373954 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.373961 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.374183 (+ 222us) server_negotiation.cc:407] Connection header received
0805 22:53:38.374415 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.374420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.374490 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.374599 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:38.375156 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.375872 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.377948 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.378740 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.378941 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.379019 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.379318 (+ 299us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.379450 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260805 22:53:38.379871 23999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.373418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34347 (local address 127.20.34.66:58197)
0805 22:53:38.374073 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.374087 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.374256 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.374613 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.374617 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.374640 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:38.374984 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.374993 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.376114 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.376119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.377782 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.377796 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.378971 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.378978 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.379149 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.379174 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.379289 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.379422 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":22,"thread_start_us":303,"threads_started":1}
I20260805 22:53:38.380935 23482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb665918309746a798ab972a645ac2fc" candidate_uuid: "af4ad0071d504bc188a7f9f71417dc65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d" is_pre_election: true
I20260805 22:53:38.380934 23887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb665918309746a798ab972a645ac2fc" candidate_uuid: "af4ad0071d504bc188a7f9f71417dc65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39f28b80f8974907962364f80b2b59e8" is_pre_election: true
I20260805 22:53:38.381594 23887 raft_consensus.cc:2454] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af4ad0071d504bc188a7f9f71417dc65 in term 0.
I20260805 22:53:38.381588 23482 raft_consensus.cc:2454] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af4ad0071d504bc188a7f9f71417dc65 in term 0.
I20260805 22:53:38.382408 23574 leader_election.cc:302] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39f28b80f8974907962364f80b2b59e8, af4ad0071d504bc188a7f9f71417dc65; no voters:
I20260805 22:53:38.382855 23996 raft_consensus.cc:2781] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:38.383015 23996 raft_consensus.cc:482] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:38.383145 23996 raft_consensus.cc:3037] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:38.385756 23996 raft_consensus.cc:504] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.386487 23996 leader_election.cc:288] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [CANDIDATE]: Term 1 election: Requested vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347)
I20260805 22:53:38.387183 23482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb665918309746a798ab972a645ac2fc" candidate_uuid: "af4ad0071d504bc188a7f9f71417dc65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d"
I20260805 22:53:38.387282 23887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb665918309746a798ab972a645ac2fc" candidate_uuid: "af4ad0071d504bc188a7f9f71417dc65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39f28b80f8974907962364f80b2b59e8"
I20260805 22:53:38.387450 23482 raft_consensus.cc:3037] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:38.387491 23887 raft_consensus.cc:3037] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:38.390944 23482 raft_consensus.cc:2454] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af4ad0071d504bc188a7f9f71417dc65 in term 1.
I20260805 22:53:38.390944 23887 raft_consensus.cc:2454] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af4ad0071d504bc188a7f9f71417dc65 in term 1.
I20260805 22:53:38.391475 23574 leader_election.cc:302] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 365826d6f290474f94ac48519b82af4d, af4ad0071d504bc188a7f9f71417dc65; no voters:
I20260805 22:53:38.391876 23996 raft_consensus.cc:2781] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:38.392467 23996 raft_consensus.cc:686] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 1 LEADER]: Becoming Leader. State: Replica: af4ad0071d504bc188a7f9f71417dc65, State: Running, Role: LEADER
I20260805 22:53:38.393091 23996 consensus_queue.cc:237] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } }
I20260805 22:53:38.398543 23231 catalog_manager.cc:5495] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 reported cstate change: term changed from 0 to 1, leader changed from <none> to af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66). New cstate: current_term: 1 leader_uuid: "af4ad0071d504bc188a7f9f71417dc65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } health_report { overall_health: HEALTHY } } }
W20260805 22:53:38.407480 23544 tablet.cc:2369] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 22:53:38 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970416, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:38.457264 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.443046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:36211 (local address 127.0.0.1:36916)
0805 22:53:38.443798 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.443816 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.443962 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.444346 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.444349 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.445091 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:38.445355 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.445364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.446450 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.446455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.447531 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.447544 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.448372 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.448377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.448505 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.449196 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:38.449216 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:38.451551 (+ 2335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:38.454702 (+ 3151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:38.454716 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:38.454723 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:38.455172 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:38.455544 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:38.455547 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:38.455550 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:38.455696 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:38.456295 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:38.456303 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:38.456516 (+ 213us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.456678 (+ 162us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.456917 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":403,"threads_started":1}
I20260805 22:53:38.457309 23793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.442923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36916 (local address 127.20.34.126:36211)
0805 22:53:38.443161 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.443170 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.443916 (+ 746us) server_negotiation.cc:407] Connection header received
0805 22:53:38.444076 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.444080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.444191 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.444289 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:38.445498 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.446281 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.447671 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.448119 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.448290 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.451763 (+ 3473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:38.451768 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:38.451772 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:38.451807 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:38.454546 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:38.455298 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:38.455302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:38.455304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:38.455436 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:38.455797 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:38.455800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:38.455802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:38.456073 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:38.456244 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.456786 (+ 542us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.457052 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":81}
I20260805 22:53:38.462579 23231 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:36916:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:53:38.463641 23231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:38.471069 23644 tablet_service.cc:1467] Processing CreateTablet for tablet 3c809bf4db724381a9b7fd796327eb67 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eeafefbbbcab4097a2de82ca124c3eea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:53:38.470862 23444 tablet_service.cc:1467] Processing CreateTablet for tablet 3c809bf4db724381a9b7fd796327eb67 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eeafefbbbcab4097a2de82ca124c3eea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:53:38.471091 23851 tablet_service.cc:1467] Processing CreateTablet for tablet 3c809bf4db724381a9b7fd796327eb67 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=eeafefbbbcab4097a2de82ca124c3eea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:53:38.471961 23644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c809bf4db724381a9b7fd796327eb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.471992 23851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c809bf4db724381a9b7fd796327eb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.471995 23444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c809bf4db724381a9b7fd796327eb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.477923 23987 tablet_bootstrap.cc:492] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: Bootstrap starting.
I20260805 22:53:38.479996 23987 tablet_bootstrap.cc:654] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.480147 23988 tablet_bootstrap.cc:492] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: Bootstrap starting.
I20260805 22:53:38.480598 23985 tablet_bootstrap.cc:492] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: Bootstrap starting.
I20260805 22:53:38.482367 23988 tablet_bootstrap.cc:654] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.482679 23985 tablet_bootstrap.cc:654] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.483436 23987 tablet_bootstrap.cc:492] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: No bootstrap required, opened a new log
I20260805 22:53:38.483707 23987 ts_tablet_manager.cc:1397] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260805 22:53:38.484783 23987 raft_consensus.cc:348] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.484954 23988 tablet_bootstrap.cc:492] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: No bootstrap required, opened a new log
I20260805 22:53:38.485059 23987 raft_consensus.cc:374] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.485148 23988 ts_tablet_manager.cc:1397] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260805 22:53:38.485181 23987 raft_consensus.cc:729] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4ad0071d504bc188a7f9f71417dc65, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.485476 23987 consensus_queue.cc:260] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.485813 23985 tablet_bootstrap.cc:492] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: No bootstrap required, opened a new log
I20260805 22:53:38.485975 23985 ts_tablet_manager.cc:1397] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260805 22:53:38.486032 23996 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.486263 23987 ts_tablet_manager.cc:1428] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:53:38.486367 23996 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:38.486955 23985 raft_consensus.cc:348] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.487268 23985 raft_consensus.cc:374] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.487390 23985 raft_consensus.cc:729] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365826d6f290474f94ac48519b82af4d, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.487363 23988 raft_consensus.cc:348] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.487659 23988 raft_consensus.cc:374] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.487769 23988 raft_consensus.cc:729] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39f28b80f8974907962364f80b2b59e8, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.487699 23985 consensus_queue.cc:260] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.488082 23988 consensus_queue.cc:260] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.488281 23992 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.488708 23992 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:38.488579 23994 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.488972 23994 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:38.489511 23985 ts_tablet_manager.cc:1428] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:53:38.490545 23988 ts_tablet_manager.cc:1428] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260805 22:53:38.608893 23994 raft_consensus.cc:482] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:38.609179 23994 raft_consensus.cc:504] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.610852 23994 leader_election.cc:288] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755)
I20260805 22:53:38.617558 23977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.611241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:45915 (local address 127.20.34.65:45829)
0805 22:53:38.611522 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.611532 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.612202 (+ 670us) server_negotiation.cc:407] Connection header received
0805 22:53:38.612483 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.612487 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.612549 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.612649 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:38.613210 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.614032 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.615720 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.616594 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.616775 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.616867 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.617143 (+ 276us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.617274 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260805 22:53:38.617674 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.611031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45829 (local address 127.20.34.67:45915)
0805 22:53:38.612045 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.612070 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.612323 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.612665 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.612670 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.612705 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:38.613016 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.613026 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.614179 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.614185 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.615554 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.615570 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.616771 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.616777 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.616976 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.617000 (+ 24us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.617116 (+ 116us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.617253 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"mutex_wait_us":24,"spinlock_wait_cycles":2944,"thread_start_us":914,"threads_started":1}
I20260805 22:53:38.617704 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.611521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:50981 (local address 127.20.34.66:44755)
0805 22:53:38.611790 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.611800 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.612342 (+ 542us) server_negotiation.cc:407] Connection header received
0805 22:53:38.612576 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.612581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.612641 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.612755 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:53:38.613387 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.614188 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.615860 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.616678 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.616882 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.616959 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.617311 (+ 352us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.617440 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 22:53:38.618176 24017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.611187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:44755 (local address 127.20.34.67:50981)
0805 22:53:38.612213 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.612228 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.612397 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.612767 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.612772 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.612857 (+ 85us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:53:38.613220 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.613230 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.614340 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.614346 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.615695 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.615708 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.616920 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.616928 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.617127 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.617151 (+ 24us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.617284 (+ 133us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.617420 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":895,"mutex_wait_us":3,"spinlock_wait_cycles":99072,"thread_start_us":619,"threads_started":1}
I20260805 22:53:38.618462 23482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c809bf4db724381a9b7fd796327eb67" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d" is_pre_election: true
I20260805 22:53:38.618764 23482 raft_consensus.cc:2454] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 0.
I20260805 22:53:38.619283 23783 leader_election.cc:302] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 365826d6f290474f94ac48519b82af4d, 39f28b80f8974907962364f80b2b59e8; no voters:
I20260805 22:53:38.619325 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c809bf4db724381a9b7fd796327eb67" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af4ad0071d504bc188a7f9f71417dc65" is_pre_election: true
I20260805 22:53:38.619737 23994 raft_consensus.cc:2781] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:38.619887 23994 raft_consensus.cc:482] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:38.619844 23675 raft_consensus.cc:2454] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 0.
I20260805 22:53:38.620011 23994 raft_consensus.cc:3037] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:38.622710 23994 raft_consensus.cc:504] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.623418 23994 leader_election.cc:288] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 election: Requested vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755)
I20260805 22:53:38.624001 23482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c809bf4db724381a9b7fd796327eb67" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d"
I20260805 22:53:38.624047 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c809bf4db724381a9b7fd796327eb67" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af4ad0071d504bc188a7f9f71417dc65"
I20260805 22:53:38.624303 23675 raft_consensus.cc:3037] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:38.624317 23482 raft_consensus.cc:3037] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:38.627661 23482 raft_consensus.cc:2454] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 1.
I20260805 22:53:38.627676 23675 raft_consensus.cc:2454] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 1.
I20260805 22:53:38.628245 23784 leader_election.cc:302] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 365826d6f290474f94ac48519b82af4d, 39f28b80f8974907962364f80b2b59e8, af4ad0071d504bc188a7f9f71417dc65; no voters:
I20260805 22:53:38.628651 23994 raft_consensus.cc:2781] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:38.629138 23994 raft_consensus.cc:686] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [term 1 LEADER]: Becoming Leader. State: Replica: 39f28b80f8974907962364f80b2b59e8, State: Running, Role: LEADER
I20260805 22:53:38.629679 23994 consensus_queue.cc:237] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.633989 24020 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: TxnStatusTablet state changed. Reason: New leader 39f28b80f8974907962364f80b2b59e8. Latest consensus state: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.634351 24020 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:53:38.635105 24023 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:53:38.635421 24023 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:53:38.634773 23230 catalog_manager.cc:5495] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39f28b80f8974907962364f80b2b59e8 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } health_report { overall_health: HEALTHY } } }
I20260805 22:53:38.687722 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.680439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54092 (local address 127.20.34.67:34347)
0805 22:53:38.680612 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.680616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.681036 (+ 420us) server_negotiation.cc:407] Connection header received
0805 22:53:38.681340 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.681344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.681460 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.681577 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:38.682031 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.683359 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.685312 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.685800 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.685901 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.686471 (+ 570us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:38.687052 (+ 581us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:38.687167 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.687326 (+ 159us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.687402 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 22:53:38.688057 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.680490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34347 (local address 127.0.0.1:54092)
0805 22:53:38.680921 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.680943 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.681106 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.681635 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.681641 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.681656 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:53:38.681897 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.681910 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.683500 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.683506 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.685138 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.685154 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.685973 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.685980 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.686181 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.686268 (+ 87us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:53:38.687170 (+ 902us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:53:38.687192 (+ 22us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.687295 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.687470 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233}
I20260805 22:53:38.697091 23675 raft_consensus.cc:1261] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Refusing update from remote peer 39f28b80f8974907962364f80b2b59e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:38.697151 23482 raft_consensus.cc:1261] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Refusing update from remote peer 39f28b80f8974907962364f80b2b59e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:38.698154 23994 consensus_queue.cc:1035] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:38.698552 24020 consensus_queue.cc:1035] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:38.713143 23996 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: TxnStatusTablet state changed. Reason: New leader 39f28b80f8974907962364f80b2b59e8. Latest consensus state: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.713581 23996 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:38.716341 24026 mvcc.cc:205] Tried to move back new op lower bound from 7315334834971602944 to 7315334834711683072. Current Snapshot: MvccSnapshot[applied={T|T < 7315334834971602944}]
I20260805 22:53:38.717865 23992 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: TxnStatusTablet state changed. Reason: New leader 39f28b80f8974907962364f80b2b59e8. Latest consensus state: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.718221 23992 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:38.726164 24028 mvcc.cc:205] Tried to move back new op lower bound from 7315334834971602944 to 7315334834711683072. Current Snapshot: MvccSnapshot[applied={T|T < 7315334834971602944}]
I20260805 22:53:38.729555 23994 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.730020 23994 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:53:38.730681 23994 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.731042 23994 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P 39f28b80f8974907962364f80b2b59e8: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:53:38.734169 23996 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.734593 23996 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P af4ad0071d504bc188a7f9f71417dc65: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:38.737001 23992 tablet_replica.cc:439] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } } }
I20260805 22:53:38.737289 23992 tablet_replica.cc:442] T 3c809bf4db724381a9b7fd796327eb67 P 365826d6f290474f94ac48519b82af4d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:53:38.747844 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.740879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57756 (local address 127.20.34.66:44755)
0805 22:53:38.741072 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.741080 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.741603 (+ 523us) server_negotiation.cc:407] Connection header received
0805 22:53:38.742006 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.742012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.742121 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.742329 (+ 208us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:38.742902 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.743741 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.745293 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.745746 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.745903 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.746409 (+ 506us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:38.746970 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:38.747143 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.747254 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.747430 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 22:53:38.767205 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.760570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:36851 (local address 127.20.34.67:34347)
0805 22:53:38.760833 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.760843 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.761420 (+ 577us) server_negotiation.cc:407] Connection header received
0805 22:53:38.761615 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.761619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.761693 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.761805 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:38.762403 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.763190 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.765339 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.765797 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.765904 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.766516 (+ 612us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:38.766628 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:38.766697 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.766885 (+ 188us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.766961 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:53:38.767416 24040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.760568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34347 (local address 127.20.34.66:36851)
0805 22:53:38.761294 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.761316 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.761476 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.761850 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.761856 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.761870 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:53:38.762221 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.762233 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.763338 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.763343 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.765171 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.765188 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.765989 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.765995 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.766195 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.766284 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:53:38.766731 (+ 447us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:53:38.766750 (+ 19us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.766841 (+ 91us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.767000 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":386,"threads_started":1}
I20260805 22:53:38.779166 23482 raft_consensus.cc:1261] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Refusing update from remote peer af4ad0071d504bc188a7f9f71417dc65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:38.779448 23887 raft_consensus.cc:1261] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Refusing update from remote peer af4ad0071d504bc188a7f9f71417dc65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:38.779850 23996 consensus_queue.cc:1035] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:38.780225 24000 consensus_queue.cc:1035] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:38.786214 24027 mvcc.cc:205] Tried to move back new op lower bound from 7315334835312230400 to 7315334833743134720. Current Snapshot: MvccSnapshot[applied={T|T < 7315334835312230400}]
I20260805 22:53:38.824604 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.812471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:41747 (local address 127.20.34.66:44755)
0805 22:53:38.812745 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:38.812755 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:38.816938 (+ 4183us) server_negotiation.cc:407] Connection header received
0805 22:53:38.817643 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:38.817649 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:38.817749 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:38.817858 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:38.818597 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.819755 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.822110 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.822863 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.823011 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.823665 (+ 654us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:38.823833 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:38.823901 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:38.824201 (+ 300us) server_negotiation.cc:299] Negotiation successful
0805 22:53:38.824313 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260805 22:53:38.825026 24051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:38.811724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:44755 (local address 127.20.34.67:41747)
0805 22:53:38.816828 (+ 5104us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:38.816850 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:38.817428 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:38.817889 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:38.817895 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:38.817915 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:53:38.818386 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.818400 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.819951 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.819957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.821889 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:38.821942 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:38.823071 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:38.823079 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:38.823310 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:38.823411 (+ 101us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:53:38.824015 (+ 604us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:53:38.824025 (+ 10us) client_negotiation.cc:769] Sending connection context
0805 22:53:38.824139 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 22:53:38.824353 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4874,"thread_start_us":4652,"threads_started":1}
I20260805 22:53:38.873672 23230 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:38.874008 23230 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:38.878628 23230 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: Sending DeleteTablet for 3 replicas of tablet cb665918309746a798ab972a645ac2fc
I20260805 22:53:38.880002 23444 tablet_service.cc:1514] Processing DeleteTablet for tablet cb665918309746a798ab972a645ac2fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:38 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:48512
I20260805 22:53:38.880056 23851 tablet_service.cc:1514] Processing DeleteTablet for tablet cb665918309746a798ab972a645ac2fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:38 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:54078
I20260805 22:53:38.880379 23644 tablet_service.cc:1514] Processing DeleteTablet for tablet cb665918309746a798ab972a645ac2fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:38 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57742
I20260805 22:53:38.883499 23230 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:53:38.884490 23230 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:38.888356 24056 tablet_replica.cc:330] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: stopping tablet replica
I20260805 22:53:38.889034 24056 raft_consensus.cc:2229] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:38.889531 24056 raft_consensus.cc:2258] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:38.891721 24056 ts_tablet_manager.cc:1905] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:38.896526 24058 tablet_replica.cc:330] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: stopping tablet replica
I20260805 22:53:38.897954 23851 tablet_service.cc:1467] Processing CreateTablet for tablet e5e9e262307447b792859acbcf180809 (DEFAULT_TABLE table=test-table [id=a3cd313f7b5242d1bed092233155c4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:38.897981 23442 tablet_service.cc:1467] Processing CreateTablet for tablet e5e9e262307447b792859acbcf180809 (DEFAULT_TABLE table=test-table [id=a3cd313f7b5242d1bed092233155c4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:38.898487 23851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e9e262307447b792859acbcf180809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.898548 23442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e9e262307447b792859acbcf180809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.900736 24056 ts_tablet_manager.cc:1918] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:38.901005 24056 log.cc:1196] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/cb665918309746a798ab972a645ac2fc
I20260805 22:53:38.897047 24058 raft_consensus.cc:2229] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:53:38.901131 23643 tablet_service.cc:1467] Processing CreateTablet for tablet e5e9e262307447b792859acbcf180809 (DEFAULT_TABLE table=test-table [id=a3cd313f7b5242d1bed092233155c4f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:38.902820 23643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5e9e262307447b792859acbcf180809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:38.905886 24058 raft_consensus.cc:2258] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:38.906818 23985 tablet_bootstrap.cc:492] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: Bootstrap starting.
I20260805 22:53:38.907063 24055 tablet_replica.cc:330] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: stopping tablet replica
I20260805 22:53:38.907526 24055 raft_consensus.cc:2229] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:38.907987 24055 raft_consensus.cc:2258] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:38.908911 23985 tablet_bootstrap.cc:654] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.912511 23988 tablet_bootstrap.cc:492] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: Bootstrap starting.
I20260805 22:53:38.914407 23988 tablet_bootstrap.cc:654] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.912241 24058 ts_tablet_manager.cc:1905] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:38.924796 24056 ts_tablet_manager.cc:1939] T cb665918309746a798ab972a645ac2fc P 39f28b80f8974907962364f80b2b59e8: Deleting consensus metadata
I20260805 22:53:38.925837 23987 tablet_bootstrap.cc:492] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: Bootstrap starting.
I20260805 22:53:38.927799 23987 tablet_bootstrap.cc:654] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:38.928393 23211 catalog_manager.cc:4841] TS 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347): tablet cb665918309746a798ab972a645ac2fc (table test-table [id=4d6fbca84a7a4f1d8c61ce4877538a47]) successfully deleted
I20260805 22:53:38.935035 23987 tablet_bootstrap.cc:492] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: No bootstrap required, opened a new log
I20260805 22:53:38.935355 23987 ts_tablet_manager.cc:1397] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260805 22:53:38.936420 23987 raft_consensus.cc:348] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.936870 23987 raft_consensus.cc:374] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.937016 23987 raft_consensus.cc:729] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4ad0071d504bc188a7f9f71417dc65, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.937454 23987 consensus_queue.cc:260] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.939072 24055 ts_tablet_manager.cc:1905] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:38.941661 23987 ts_tablet_manager.cc:1428] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260805 22:53:38.949601 23988 tablet_bootstrap.cc:492] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: No bootstrap required, opened a new log
I20260805 22:53:38.949929 23988 ts_tablet_manager.cc:1397] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: Time spent bootstrapping tablet: real 0.037s user 0.010s sys 0.002s
I20260805 22:53:38.950929 23988 raft_consensus.cc:348] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.951692 23988 raft_consensus.cc:374] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.951853 23988 raft_consensus.cc:729] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39f28b80f8974907962364f80b2b59e8, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.951936 24058 ts_tablet_manager.cc:1918] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:38.952246 24058 log.cc:1196] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/cb665918309746a798ab972a645ac2fc
I20260805 22:53:38.952394 23988 consensus_queue.cc:260] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.953019 24058 ts_tablet_manager.cc:1939] T cb665918309746a798ab972a645ac2fc P af4ad0071d504bc188a7f9f71417dc65: Deleting consensus metadata
I20260805 22:53:38.954101 23985 tablet_bootstrap.cc:492] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: No bootstrap required, opened a new log
I20260805 22:53:38.954370 23985 ts_tablet_manager.cc:1397] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.008s
I20260805 22:53:38.955227 23214 catalog_manager.cc:4841] TS af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755): tablet cb665918309746a798ab972a645ac2fc (table test-table [id=4d6fbca84a7a4f1d8c61ce4877538a47]) successfully deleted
I20260805 22:53:38.955251 23985 raft_consensus.cc:348] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.956200 23988 ts_tablet_manager.cc:1428] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260805 22:53:38.961995 23985 raft_consensus.cc:374] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:38.962102 23985 raft_consensus.cc:729] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365826d6f290474f94ac48519b82af4d, State: Initialized, Role: FOLLOWER
I20260805 22:53:38.961516 24055 ts_tablet_manager.cc:1918] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:38.962498 24055 log.cc:1196] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/cb665918309746a798ab972a645ac2fc
I20260805 22:53:38.962399 23985 consensus_queue.cc:260] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:38.963357 24055 ts_tablet_manager.cc:1939] T cb665918309746a798ab972a645ac2fc P 365826d6f290474f94ac48519b82af4d: Deleting consensus metadata
I20260805 22:53:38.964335 23985 ts_tablet_manager.cc:1428] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260805 22:53:38.966346 23211 catalog_manager.cc:4841] TS 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829): tablet cb665918309746a798ab972a645ac2fc (table test-table [id=4d6fbca84a7a4f1d8c61ce4877538a47]) successfully deleted
I20260805 22:53:39.057142 24020 raft_consensus.cc:482] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:39.057430 24020 raft_consensus.cc:504] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:39.058246 24020 leader_election.cc:288] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755)
I20260805 22:53:39.059044 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e9e262307447b792859acbcf180809" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af4ad0071d504bc188a7f9f71417dc65" is_pre_election: true
I20260805 22:53:39.059012 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e9e262307447b792859acbcf180809" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d" is_pre_election: true
I20260805 22:53:39.059363 23675 raft_consensus.cc:2454] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 0.
I20260805 22:53:39.059405 23481 raft_consensus.cc:2454] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 0.
I20260805 22:53:39.059969 23783 leader_election.cc:302] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 365826d6f290474f94ac48519b82af4d, 39f28b80f8974907962364f80b2b59e8; no voters:
I20260805 22:53:39.060405 24020 raft_consensus.cc:2781] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:39.060526 24020 raft_consensus.cc:482] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:39.060648 24020 raft_consensus.cc:3037] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:39.064213 24020 raft_consensus.cc:504] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:39.065634 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e9e262307447b792859acbcf180809" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d"
I20260805 22:53:39.065640 23675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5e9e262307447b792859acbcf180809" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af4ad0071d504bc188a7f9f71417dc65"
I20260805 22:53:39.065874 23675 raft_consensus.cc:3037] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:39.065878 23481 raft_consensus.cc:3037] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:39.069334 23481 raft_consensus.cc:2454] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 1.
I20260805 22:53:39.070151 23783 leader_election.cc:302] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 365826d6f290474f94ac48519b82af4d, 39f28b80f8974907962364f80b2b59e8; no voters:
I20260805 22:53:39.070361 23675 raft_consensus.cc:2454] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 1.
I20260805 22:53:39.070560 23994 raft_consensus.cc:2781] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:39.071961 24020 leader_election.cc:288] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 election: Requested vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755)
I20260805 22:53:39.073293 23994 raft_consensus.cc:686] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 1 LEADER]: Becoming Leader. State: Replica: 39f28b80f8974907962364f80b2b59e8, State: Running, Role: LEADER
I20260805 22:53:39.073678 23994 consensus_queue.cc:237] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:39.090286 23230 catalog_manager.cc:5495] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39f28b80f8974907962364f80b2b59e8 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } health_report { overall_health: HEALTHY } } }
I20260805 22:53:39.136916 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:39.129714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54104 (local address 127.20.34.67:34347)
0805 22:53:39.129947 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:39.129956 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:39.129981 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:53:39.130077 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:39.130085 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:39.130227 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:39.130348 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:39.131174 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:39.133112 (+ 1938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:39.134932 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:39.135398 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:39.135553 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:39.135994 (+ 441us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:39.136121 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:39.136320 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:39.136480 (+ 160us) server_negotiation.cc:299] Negotiation successful
0805 22:53:39.136574 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:53:39.151355 24051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:39.145833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34347 (local address 127.20.34.67:50891)
0805 22:53:39.146105 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:39.146120 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:39.146260 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:39.146564 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:39.146568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:39.146578 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:53:39.146883 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:39.146894 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:39.147990 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:39.147997 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:39.149459 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:39.149474 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:39.150192 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:39.150197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:39.150365 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:39.150402 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:53:39.150790 (+ 388us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:53:39.150803 (+ 13us) client_negotiation.cc:769] Sending connection context
0805 22:53:39.150882 (+ 79us) client_negotiation.cc:240] Negotiation successful
0805 22:53:39.151025 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":82}
I20260805 22:53:39.151353 23984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:39.145749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:50891 (local address 127.20.34.67:34347)
0805 22:53:39.145931 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:39.145938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:39.146192 (+ 254us) server_negotiation.cc:407] Connection header received
0805 22:53:39.146384 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:39.146389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:39.146461 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:39.146554 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:39.147007 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:39.147825 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:39.149622 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:39.150053 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:39.150183 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:39.150578 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:39.150689 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:39.150791 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:39.150897 (+ 106us) server_negotiation.cc:299] Negotiation successful
0805 22:53:39.150978 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":62}
I20260805 22:53:39.163067 23481 raft_consensus.cc:1261] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Refusing update from remote peer 39f28b80f8974907962364f80b2b59e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:39.163648 23675 raft_consensus.cc:1261] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Refusing update from remote peer 39f28b80f8974907962364f80b2b59e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:39.163693 24063 consensus_queue.cc:1035] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:39.164453 24020 consensus_queue.cc:1035] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:53:39.203853 24026 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260805 22:53:40.807969 23230 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:40.808305 23230 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:40.813004 23230 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: Sending DeleteTablet for 3 replicas of tablet e5e9e262307447b792859acbcf180809
I20260805 22:53:40.814034 23643 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e9e262307447b792859acbcf180809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:40 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57742
I20260805 22:53:40.814050 23850 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e9e262307447b792859acbcf180809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:40 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:54078
I20260805 22:53:40.814092 23442 tablet_service.cc:1514] Processing DeleteTablet for tablet e5e9e262307447b792859acbcf180809 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:40 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:48512
I20260805 22:53:40.829568 24099 tablet_replica.cc:330] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: stopping tablet replica
I20260805 22:53:40.830035 24099 raft_consensus.cc:2229] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:40.830452 24099 raft_consensus.cc:2258] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:40.831874 24099 ts_tablet_manager.cc:1905] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:40.838214 24095 tablet_replica.cc:330] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: stopping tablet replica
I20260805 22:53:40.838534 24097 tablet_replica.cc:330] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: stopping tablet replica
I20260805 22:53:40.838579 24095 raft_consensus.cc:2229] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:40.838852 24097 raft_consensus.cc:2229] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:53:40.838977 24095 raft_consensus.cc:2258] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:40.839571 24097 raft_consensus.cc:2258] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:40.840073 24099 ts_tablet_manager.cc:1918] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:53:40.840391 24099 log.cc:1196] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/e5e9e262307447b792859acbcf180809
I20260805 22:53:40.840667 24095 ts_tablet_manager.cc:1905] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:40.840727 24097 ts_tablet_manager.cc:1905] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:40.840976 24099 ts_tablet_manager.cc:1939] T e5e9e262307447b792859acbcf180809 P 365826d6f290474f94ac48519b82af4d: Deleting consensus metadata
I20260805 22:53:40.842376 23211 catalog_manager.cc:4841] TS 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829): tablet e5e9e262307447b792859acbcf180809 (table test-table [id=a3cd313f7b5242d1bed092233155c4f9]) successfully deleted
I20260805 22:53:40.846243 24095 ts_tablet_manager.cc:1918] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:53:40.846993 24095 log.cc:1196] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/e5e9e262307447b792859acbcf180809
I20260805 22:53:40.847577 24095 ts_tablet_manager.cc:1939] T e5e9e262307447b792859acbcf180809 P af4ad0071d504bc188a7f9f71417dc65: Deleting consensus metadata
I20260805 22:53:40.848529 24097 ts_tablet_manager.cc:1918] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:53:40.848707 24097 log.cc:1196] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/e5e9e262307447b792859acbcf180809
I20260805 22:53:40.849025 23214 catalog_manager.cc:4841] TS af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755): tablet e5e9e262307447b792859acbcf180809 (table test-table [id=a3cd313f7b5242d1bed092233155c4f9]) successfully deleted
I20260805 22:53:40.849260 24097 ts_tablet_manager.cc:1939] T e5e9e262307447b792859acbcf180809 P 39f28b80f8974907962364f80b2b59e8: Deleting consensus metadata
I20260805 22:53:40.850301 23211 catalog_manager.cc:4841] TS 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347): tablet e5e9e262307447b792859acbcf180809 (table test-table [id=a3cd313f7b5242d1bed092233155c4f9]) successfully deleted
Aug 05 22:53:40 dist-test-slave-gmjp krb5kdc[23171](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:53:40 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:40.891808 24114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:40.875743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36926 (local address 127.20.34.126:36211)
0805 22:53:40.876435 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:40.876440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:40.876464 (+ 24us) server_negotiation.cc:407] Connection header received
0805 22:53:40.876526 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:40.876530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:40.876595 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:40.876699 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:40.878247 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:40.879182 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:40.880625 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:40.881079 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:40.881248 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:40.885689 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:40.885695 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:40.885698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:40.885741 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:40.888676 (+ 2935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:40.889524 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:40.889530 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:40.889532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:40.889695 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:40.890173 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:40.890177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:40.890179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:40.890514 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:40.890786 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:40.891155 (+ 369us) server_negotiation.cc:299] Negotiation successful
0805 22:53:40.891428 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":399,"threads_started":1}
I20260805 22:53:40.896325 23230 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:53:40.897025 23230 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:40.903858 23442 tablet_service.cc:1467] Processing CreateTablet for tablet 03efa43d417b469291cac98ac676d9dc (DEFAULT_TABLE table=test-table [id=8d5e2201594a43b19614151b50ababa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:40.904003 23643 tablet_service.cc:1467] Processing CreateTablet for tablet 03efa43d417b469291cac98ac676d9dc (DEFAULT_TABLE table=test-table [id=8d5e2201594a43b19614151b50ababa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:40.904402 23442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03efa43d417b469291cac98ac676d9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:40.904554 23643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03efa43d417b469291cac98ac676d9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:40.904523 23850 tablet_service.cc:1467] Processing CreateTablet for tablet 03efa43d417b469291cac98ac676d9dc (DEFAULT_TABLE table=test-table [id=8d5e2201594a43b19614151b50ababa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:40.905058 23850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03efa43d417b469291cac98ac676d9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:40.919292 24116 tablet_bootstrap.cc:492] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: Bootstrap starting.
I20260805 22:53:40.920130 24119 tablet_bootstrap.cc:492] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: Bootstrap starting.
I20260805 22:53:40.921324 24117 tablet_bootstrap.cc:492] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: Bootstrap starting.
I20260805 22:53:40.921800 24116 tablet_bootstrap.cc:654] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:40.923096 24119 tablet_bootstrap.cc:654] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:40.925001 24117 tablet_bootstrap.cc:654] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:40.930872 24116 tablet_bootstrap.cc:492] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: No bootstrap required, opened a new log
I20260805 22:53:40.931177 24116 ts_tablet_manager.cc:1397] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260805 22:53:40.932308 24116 raft_consensus.cc:348] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.932736 24116 raft_consensus.cc:374] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:40.932902 24116 raft_consensus.cc:729] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4ad0071d504bc188a7f9f71417dc65, State: Initialized, Role: FOLLOWER
I20260805 22:53:40.933301 24116 consensus_queue.cc:260] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.934711 24117 tablet_bootstrap.cc:492] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: No bootstrap required, opened a new log
I20260805 22:53:40.934940 24119 tablet_bootstrap.cc:492] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: No bootstrap required, opened a new log
I20260805 22:53:40.934990 24117 ts_tablet_manager.cc:1397] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.005s
I20260805 22:53:40.935154 24119 ts_tablet_manager.cc:1397] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.012s
I20260805 22:53:40.936002 24119 raft_consensus.cc:348] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.936316 24119 raft_consensus.cc:374] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:40.936441 24119 raft_consensus.cc:729] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39f28b80f8974907962364f80b2b59e8, State: Initialized, Role: FOLLOWER
I20260805 22:53:40.936223 24117 raft_consensus.cc:348] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.936540 24117 raft_consensus.cc:374] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:40.936739 24117 raft_consensus.cc:729] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365826d6f290474f94ac48519b82af4d, State: Initialized, Role: FOLLOWER
I20260805 22:53:40.936756 24119 consensus_queue.cc:260] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.937126 24117 consensus_queue.cc:260] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.937477 24119 ts_tablet_manager.cc:1428] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:53:40.943260 24116 ts_tablet_manager.cc:1428] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260805 22:53:40.944031 24117 ts_tablet_manager.cc:1428] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260805 22:53:40.952589 24128 raft_consensus.cc:482] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:40.952852 24128 raft_consensus.cc:504] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.953688 24128 leader_election.cc:288] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347)
I20260805 22:53:40.954340 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03efa43d417b469291cac98ac676d9dc" candidate_uuid: "af4ad0071d504bc188a7f9f71417dc65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d" is_pre_election: true
I20260805 22:53:40.954447 23887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03efa43d417b469291cac98ac676d9dc" candidate_uuid: "af4ad0071d504bc188a7f9f71417dc65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39f28b80f8974907962364f80b2b59e8" is_pre_election: true
I20260805 22:53:40.954612 23481 raft_consensus.cc:2454] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af4ad0071d504bc188a7f9f71417dc65 in term 0.
I20260805 22:53:40.954743 23887 raft_consensus.cc:2454] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af4ad0071d504bc188a7f9f71417dc65 in term 0.
I20260805 22:53:40.955147 23574 leader_election.cc:302] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 365826d6f290474f94ac48519b82af4d, af4ad0071d504bc188a7f9f71417dc65; no voters:
I20260805 22:53:40.955466 24128 raft_consensus.cc:2781] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:40.955607 24128 raft_consensus.cc:482] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:40.955732 24128 raft_consensus.cc:3037] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:40.958279 24128 raft_consensus.cc:504] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.958858 24128 leader_election.cc:288] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [CANDIDATE]: Term 1 election: Requested vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347)
I20260805 22:53:40.959529 23481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03efa43d417b469291cac98ac676d9dc" candidate_uuid: "af4ad0071d504bc188a7f9f71417dc65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d"
I20260805 22:53:40.959649 23887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03efa43d417b469291cac98ac676d9dc" candidate_uuid: "af4ad0071d504bc188a7f9f71417dc65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39f28b80f8974907962364f80b2b59e8"
I20260805 22:53:40.959789 23481 raft_consensus.cc:3037] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:40.959892 23887 raft_consensus.cc:3037] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:40.963059 23481 raft_consensus.cc:2454] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af4ad0071d504bc188a7f9f71417dc65 in term 1.
I20260805 22:53:40.963059 23887 raft_consensus.cc:2454] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af4ad0071d504bc188a7f9f71417dc65 in term 1.
I20260805 22:53:40.963562 23574 leader_election.cc:302] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 365826d6f290474f94ac48519b82af4d, af4ad0071d504bc188a7f9f71417dc65; no voters:
I20260805 22:53:40.963946 24128 raft_consensus.cc:2781] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:40.964493 24128 raft_consensus.cc:686] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 1 LEADER]: Becoming Leader. State: Replica: af4ad0071d504bc188a7f9f71417dc65, State: Running, Role: LEADER
I20260805 22:53:40.964896 24128 consensus_queue.cc:237] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:40.967835 23230 catalog_manager.cc:5495] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 reported cstate change: term changed from 0 to 1, leader changed from <none> to af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66). New cstate: current_term: 1 leader_uuid: "af4ad0071d504bc188a7f9f71417dc65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } health_report { overall_health: UNKNOWN } } }
I20260805 22:53:41.001492 24137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:40.995928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57762 (local address 127.20.34.66:44755)
0805 22:53:40.996610 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:40.996615 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:40.996634 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:53:40.996691 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:40.996695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:40.996761 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:40.996878 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:40.997307 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:40.998128 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:40.999458 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:40.999907 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:41.000056 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:41.000607 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:41.000723 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:41.000832 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:41.001012 (+ 180us) server_negotiation.cc:299] Negotiation successful
0805 22:53:41.001102 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":368,"threads_started":1}
I20260805 22:53:41.011412 23887 raft_consensus.cc:1261] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Refusing update from remote peer af4ad0071d504bc188a7f9f71417dc65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:41.011458 23481 raft_consensus.cc:1261] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Refusing update from remote peer af4ad0071d504bc188a7f9f71417dc65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:41.012084 24128 consensus_queue.cc:1035] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:41.012427 24134 consensus_queue.cc:1035] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:41.064971 23231 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:41.065214 23231 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:41.068311 23231 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: Sending DeleteTablet for 3 replicas of tablet 03efa43d417b469291cac98ac676d9dc
I20260805 22:53:41.069247 23442 tablet_service.cc:1514] Processing DeleteTablet for tablet 03efa43d417b469291cac98ac676d9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:41 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:48512
I20260805 22:53:41.069324 23643 tablet_service.cc:1514] Processing DeleteTablet for tablet 03efa43d417b469291cac98ac676d9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:41 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57742
I20260805 22:53:41.069326 23850 tablet_service.cc:1514] Processing DeleteTablet for tablet 03efa43d417b469291cac98ac676d9dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:41 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:54078
I20260805 22:53:41.069631 24099 tablet_replica.cc:330] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: stopping tablet replica
I20260805 22:53:41.069734 24097 tablet_replica.cc:330] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: stopping tablet replica
I20260805 22:53:41.069726 24095 tablet_replica.cc:330] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: stopping tablet replica
I20260805 22:53:41.069849 24099 raft_consensus.cc:2229] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:41.069938 24097 raft_consensus.cc:2229] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:41.069972 24095 raft_consensus.cc:2229] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:53:41.070078 24099 raft_consensus.cc:2258] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:41.070156 24097 raft_consensus.cc:2258] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:41.070312 24095 raft_consensus.cc:2258] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:41.071394 24097 ts_tablet_manager.cc:1905] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:41.071394 24099 ts_tablet_manager.cc:1905] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:41.071441 24095 ts_tablet_manager.cc:1905] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:41.072463 23231 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260805 22:53:41.078676 24095 ts_tablet_manager.cc:1918] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:41.078679 24099 ts_tablet_manager.cc:1918] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:41.078785 24097 ts_tablet_manager.cc:1918] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:53:41.078873 24099 log.cc:1196] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/03efa43d417b469291cac98ac676d9dc
I20260805 22:53:41.078972 24095 log.cc:1196] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/03efa43d417b469291cac98ac676d9dc
I20260805 22:53:41.079084 24097 log.cc:1196] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/03efa43d417b469291cac98ac676d9dc
I20260805 22:53:41.079435 24095 ts_tablet_manager.cc:1939] T 03efa43d417b469291cac98ac676d9dc P af4ad0071d504bc188a7f9f71417dc65: Deleting consensus metadata
I20260805 22:53:41.079447 24099 ts_tablet_manager.cc:1939] T 03efa43d417b469291cac98ac676d9dc P 365826d6f290474f94ac48519b82af4d: Deleting consensus metadata
I20260805 22:53:41.079598 24097 ts_tablet_manager.cc:1939] T 03efa43d417b469291cac98ac676d9dc P 39f28b80f8974907962364f80b2b59e8: Deleting consensus metadata
I20260805 22:53:41.080823 23214 catalog_manager.cc:4841] TS af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755): tablet 03efa43d417b469291cac98ac676d9dc (table test-table [id=8d5e2201594a43b19614151b50ababa1]) successfully deleted
I20260805 22:53:41.080856 23211 catalog_manager.cc:4841] TS 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347): tablet 03efa43d417b469291cac98ac676d9dc (table test-table [id=8d5e2201594a43b19614151b50ababa1]) successfully deleted
I20260805 22:53:41.081514 23211 catalog_manager.cc:4841] TS 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829): tablet 03efa43d417b469291cac98ac676d9dc (table test-table [id=8d5e2201594a43b19614151b50ababa1]) successfully deleted
W20260805 22:53:41.081707 23231 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:53:41.089347 23442 tablet_service.cc:1467] Processing CreateTablet for tablet 6e1e18de446f44c88d21875528c9bac6 (DEFAULT_TABLE table=test-table [id=6d842b0634a04903acf31f0cdf9a282c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:41.089782 23850 tablet_service.cc:1467] Processing CreateTablet for tablet 6e1e18de446f44c88d21875528c9bac6 (DEFAULT_TABLE table=test-table [id=6d842b0634a04903acf31f0cdf9a282c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:41.089879 23442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e1e18de446f44c88d21875528c9bac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:41.090232 23850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e1e18de446f44c88d21875528c9bac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:41.095754 24119 tablet_bootstrap.cc:492] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: Bootstrap starting.
I20260805 22:53:41.096652 23643 tablet_service.cc:1467] Processing CreateTablet for tablet 6e1e18de446f44c88d21875528c9bac6 (DEFAULT_TABLE table=test-table [id=6d842b0634a04903acf31f0cdf9a282c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:53:41.097105 23643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e1e18de446f44c88d21875528c9bac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:41.097558 24119 tablet_bootstrap.cc:654] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:41.099858 24119 tablet_bootstrap.cc:492] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: No bootstrap required, opened a new log
I20260805 22:53:41.100049 24119 ts_tablet_manager.cc:1397] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260805 22:53:41.100798 24119 raft_consensus.cc:348] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.101066 24119 raft_consensus.cc:374] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:41.101182 24119 raft_consensus.cc:729] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39f28b80f8974907962364f80b2b59e8, State: Initialized, Role: FOLLOWER
I20260805 22:53:41.101454 24119 consensus_queue.cc:260] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.102000 24119 ts_tablet_manager.cc:1428] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260805 22:53:41.103760 24116 tablet_bootstrap.cc:492] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: Bootstrap starting.
I20260805 22:53:41.104810 24117 tablet_bootstrap.cc:492] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: Bootstrap starting.
I20260805 22:53:41.105862 24116 tablet_bootstrap.cc:654] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:41.106439 24117 tablet_bootstrap.cc:654] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:41.113638 24117 tablet_bootstrap.cc:492] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: No bootstrap required, opened a new log
I20260805 22:53:41.113909 24117 ts_tablet_manager.cc:1397] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260805 22:53:41.114717 24117 raft_consensus.cc:348] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.115005 24117 raft_consensus.cc:374] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:41.115119 24117 raft_consensus.cc:729] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365826d6f290474f94ac48519b82af4d, State: Initialized, Role: FOLLOWER
I20260805 22:53:41.115402 24117 consensus_queue.cc:260] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.115996 24117 ts_tablet_manager.cc:1428] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:53:41.118232 24116 tablet_bootstrap.cc:492] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: No bootstrap required, opened a new log
I20260805 22:53:41.118494 24116 ts_tablet_manager.cc:1397] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.003s
I20260805 22:53:41.119534 24116 raft_consensus.cc:348] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.119872 24116 raft_consensus.cc:374] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:41.119987 24116 raft_consensus.cc:729] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af4ad0071d504bc188a7f9f71417dc65, State: Initialized, Role: FOLLOWER
I20260805 22:53:41.120326 24116 consensus_queue.cc:260] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.120961 24116 ts_tablet_manager.cc:1428] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:53:41.273092 24072 raft_consensus.cc:482] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:53:41.273427 24072 raft_consensus.cc:504] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.274251 24072 leader_election.cc:288] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755)
I20260805 22:53:41.275002 23482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e18de446f44c88d21875528c9bac6" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d" is_pre_election: true
I20260805 22:53:41.275015 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e18de446f44c88d21875528c9bac6" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af4ad0071d504bc188a7f9f71417dc65" is_pre_election: true
I20260805 22:53:41.275292 23674 raft_consensus.cc:2454] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 0.
I20260805 22:53:41.275293 23482 raft_consensus.cc:2454] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 0.
I20260805 22:53:41.275784 23783 leader_election.cc:302] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 365826d6f290474f94ac48519b82af4d, 39f28b80f8974907962364f80b2b59e8; no voters:
I20260805 22:53:41.276099 24072 raft_consensus.cc:2781] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:53:41.276244 24072 raft_consensus.cc:482] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:53:41.276317 24072 raft_consensus.cc:3037] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:41.278554 24072 raft_consensus.cc:504] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.279115 24072 leader_election.cc:288] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 election: Requested vote from peers 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829), af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755)
I20260805 22:53:41.279721 23674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e18de446f44c88d21875528c9bac6" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af4ad0071d504bc188a7f9f71417dc65"
I20260805 22:53:41.279956 23674 raft_consensus.cc:3037] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:41.279886 23482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e1e18de446f44c88d21875528c9bac6" candidate_uuid: "39f28b80f8974907962364f80b2b59e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365826d6f290474f94ac48519b82af4d"
I20260805 22:53:41.280150 23482 raft_consensus.cc:3037] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:41.282449 23674 raft_consensus.cc:2454] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 1.
I20260805 22:53:41.282720 23482 raft_consensus.cc:2454] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39f28b80f8974907962364f80b2b59e8 in term 1.
I20260805 22:53:41.282935 23784 leader_election.cc:302] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39f28b80f8974907962364f80b2b59e8, af4ad0071d504bc188a7f9f71417dc65; no voters:
I20260805 22:53:41.283345 24072 raft_consensus.cc:2781] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:41.283514 24072 raft_consensus.cc:686] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 1 LEADER]: Becoming Leader. State: Replica: 39f28b80f8974907962364f80b2b59e8, State: Running, Role: LEADER
I20260805 22:53:41.283799 24072 consensus_queue.cc:237] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } }
I20260805 22:53:41.286958 23230 catalog_manager.cc:5495] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39f28b80f8974907962364f80b2b59e8 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "39f28b80f8974907962364f80b2b59e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39f28b80f8974907962364f80b2b59e8" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34347 } health_report { overall_health: HEALTHY } } }
I20260805 22:53:41.322052 24150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:41.316333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54118 (local address 127.20.34.67:34347)
0805 22:53:41.317021 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:41.317026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:41.317044 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:53:41.317094 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:41.317098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:41.317159 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:41.317274 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:53:41.317914 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:41.318719 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:41.320074 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:41.320597 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:41.320738 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:41.321236 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:53:41.321355 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:53:41.321456 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:41.321619 (+ 163us) server_negotiation.cc:299] Negotiation successful
0805 22:53:41.321698 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":391,"threads_started":1}
I20260805 22:53:41.331244 23482 raft_consensus.cc:1261] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Refusing update from remote peer 39f28b80f8974907962364f80b2b59e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:41.331619 23675 raft_consensus.cc:1261] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Refusing update from remote peer 39f28b80f8974907962364f80b2b59e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:53:41.331811 24072 consensus_queue.cc:1035] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "365826d6f290474f94ac48519b82af4d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:53:41.332309 24066 consensus_queue.cc:1035] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af4ad0071d504bc188a7f9f71417dc65" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:53:41.354631 24070 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260805 22:53:42.982713 23230 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:42.983035 23230 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:53:42.988008 23230 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86a1eb19ea124f859e3cf1c119c4ce37: Sending DeleteTablet for 3 replicas of tablet 6e1e18de446f44c88d21875528c9bac6
I20260805 22:53:42.989123 23442 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e1e18de446f44c88d21875528c9bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:42 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:48512
I20260805 22:53:42.989141 23643 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e1e18de446f44c88d21875528c9bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:42 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57742
I20260805 22:53:42.989641 23850 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e1e18de446f44c88d21875528c9bac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:53:42 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:54078
I20260805 22:53:42.990731 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 23348
I20260805 22:53:42.998817 24184 tablet_replica.cc:330] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: stopping tablet replica
I20260805 22:53:42.999912 24184 raft_consensus.cc:2229] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:53:43.000932 24184 raft_consensus.cc:2258] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:43.003720 24184 ts_tablet_manager.cc:1905] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:43.006083 24182 tablet_replica.cc:330] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: stopping tablet replica
I20260805 22:53:43.006469 24182 raft_consensus.cc:2229] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:43.006851 24182 raft_consensus.cc:2258] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:43.008104 24182 ts_tablet_manager.cc:1905] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:43.012643 24183 tablet_replica.cc:330] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: stopping tablet replica
I20260805 22:53:43.012926 24183 raft_consensus.cc:2229] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:53:43.013257 24183 raft_consensus.cc:2258] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:53:43.014245 24184 ts_tablet_manager.cc:1918] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:53:43.014438 24184 log.cc:1196] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/6e1e18de446f44c88d21875528c9bac6
I20260805 22:53:43.014881 24184 ts_tablet_manager.cc:1939] T 6e1e18de446f44c88d21875528c9bac6 P 39f28b80f8974907962364f80b2b59e8: Deleting consensus metadata
I20260805 22:53:43.016093 23211 catalog_manager.cc:4841] TS 39f28b80f8974907962364f80b2b59e8 (127.20.34.67:34347): tablet 6e1e18de446f44c88d21875528c9bac6 (table test-table [id=6d842b0634a04903acf31f0cdf9a282c]) successfully deleted
I20260805 22:53:43.016633 24183 ts_tablet_manager.cc:1905] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:53:43.017961 24182 ts_tablet_manager.cc:1918] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:53:43.018132 24182 log.cc:1196] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/6e1e18de446f44c88d21875528c9bac6
I20260805 22:53:43.018679 24182 ts_tablet_manager.cc:1939] T 6e1e18de446f44c88d21875528c9bac6 P 365826d6f290474f94ac48519b82af4d: Deleting consensus metadata
I20260805 22:53:43.020049 23211 catalog_manager.cc:4841] TS 365826d6f290474f94ac48519b82af4d (127.20.34.65:45829): tablet 6e1e18de446f44c88d21875528c9bac6 (table test-table [id=6d842b0634a04903acf31f0cdf9a282c]) successfully deleted
Aug 05 22:53:43 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:43.023270 24183 ts_tablet_manager.cc:1918] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 22:53:43.023523 24183 log.cc:1196] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/6e1e18de446f44c88d21875528c9bac6
I20260805 22:53:43.024359 24183 ts_tablet_manager.cc:1939] T 6e1e18de446f44c88d21875528c9bac6 P af4ad0071d504bc188a7f9f71417dc65: Deleting consensus metadata
I20260805 22:53:43.026100 23214 catalog_manager.cc:4841] TS af4ad0071d504bc188a7f9f71417dc65 (127.20.34.66:44755): tablet 6e1e18de446f44c88d21875528c9bac6 (table test-table [id=6d842b0634a04903acf31f0cdf9a282c]) successfully deleted
I20260805 22:53:43.028754 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:42.993034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45048 (local address 127.20.34.65:45829)
0805 22:53:43.004796 (+ 11762us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:43.004805 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:43.004843 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:53:43.004930 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:43.004939 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:43.005053 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:43.005210 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:43.007497 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:43.008712 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:43.010697 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:43.011558 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:43.011660 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:43.021646 (+ 9986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:43.021665 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:43.021684 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:43.021732 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:43.025430 (+ 3698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:43.026417 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:43.026426 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:43.026428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:43.026582 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:43.026999 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:43.027004 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:43.027008 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:43.027413 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:43.027727 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:43.028082 (+ 355us) server_negotiation.cc:299] Negotiation successful
0805 22:53:43.028404 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11551,"thread_start_us":11316,"threads_started":1}
W20260805 22:53:43.029460 23533 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45048
W20260805 22:53:43.030192 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 23348: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:43.030426 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 23348
I20260805 22:53:43.060756 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 23549
Aug 05 22:53:43 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:53:43.077700 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:43.061637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54302 (local address 127.20.34.66:44755)
0805 22:53:43.062149 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:43.062154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:43.062173 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:53:43.062240 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:43.062244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:43.062311 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:43.062404 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:43.063712 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:43.064596 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:43.065810 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:43.066205 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:43.066312 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:43.071036 (+ 4724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:43.071055 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:43.071075 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:43.071119 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:43.074211 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:43.075160 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:43.075168 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:43.075171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:43.075337 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:43.075764 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:43.075767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:43.075769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:43.076418 (+ 649us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:43.076678 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:43.077086 (+ 408us) server_negotiation.cc:299] Negotiation successful
0805 22:53:43.077354 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":265,"threads_started":1}
W20260805 22:53:43.078492 23751 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54302
W20260805 22:53:43.079183 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 23549: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:43.079378 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 23549
I20260805 22:53:43.120522 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 23760
Aug 05 22:53:43 dist-test-slave-gmjp krb5kdc[23171](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970420, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:53:43.138422 24189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:43.121556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41340 (local address 127.20.34.67:34347)
0805 22:53:43.122341 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:43.122346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:43.122364 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:53:43.122445 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:43.122449 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:43.122514 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:43.122660 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:43.124533 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:43.125322 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:43.126588 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:43.127040 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:43.127165 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:43.131787 (+ 4622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:43.131808 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:43.131826 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:43.131869 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:43.134979 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:43.135803 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:43.135812 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:43.135815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:43.135982 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:43.136520 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:43.136526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:43.136532 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:43.136974 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:43.137334 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:43.137724 (+ 390us) server_negotiation.cc:299] Negotiation successful
0805 22:53:43.138003 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":479,"threads_started":1}
W20260805 22:53:43.139245 23948 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41340
W20260805 22:53:43.140067 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 23760: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:43.140353 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 23760
I20260805 22:53:43.178619 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 23189
I20260805 22:53:43.180126 23307 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:43.316493 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 23189
2026-08-05T22:53:43Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9149 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:43 dist-test-slave-gmjp krb5kdc[24197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:43 dist-test-slave-gmjp krb5kdc[24197](info): set up 2 sockets
Aug 05 22:53:43 dist-test-slave-gmjp krb5kdc[24197](info): commencing operation
krb5kdc: starting...
W20260805 22:53:44.632494 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:53:44 dist-test-slave-gmjp krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:53:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:53:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:53:44.895884 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45599
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:45599
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:45.257891 24215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:45.258208 24215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:45.258366 24215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:45.265964 24215 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:53:45.266083 24215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:45.266172 24215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:45.266283 24215 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:53:45.266369 24215 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:53:45.276619 24215 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:45599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:45.278095 24215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:45.279558 24215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:45.292130 24226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:45.292215 24229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:45.292243 24227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:45.292500 24215 server_base.cc:1034] running on GCE node
I20260805 22:53:45.293771 24215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:45.296707 24215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:45.297998 24215 hybrid_clock.cc:648] HybridClock initialized: now 1785970425297929 us; error 37 us; skew 500 ppm
I20260805 22:53:45.298391 24215 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:45 dist-test-slave-gmjp krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970425, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:45.301941 24215 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:53:45.303704 24215 webserver.cc:460] Webserver started at http://127.20.34.126:38283/ using document root <none> and password file <none>
I20260805 22:53:45.304612 24215 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:45.304780 24215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:45.305131 24215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:45.309568 24215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "6a8a27a3279a4b6a980386d3bec2316b"
format_stamp: "Formatted at 2026-08-05 22:53:45 on dist-test-slave-gmjp"
server_key: "b5e55f65b9459155ea3f2dd89d06c356"
server_key_iv: "7cdbdb23c10600500fb01dce789ee3f1"
server_key_version: "encryptionkey@0"
I20260805 22:53:45.310621 24215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "6a8a27a3279a4b6a980386d3bec2316b"
format_stamp: "Formatted at 2026-08-05 22:53:45 on dist-test-slave-gmjp"
server_key: "b5e55f65b9459155ea3f2dd89d06c356"
server_key_iv: "7cdbdb23c10600500fb01dce789ee3f1"
server_key_version: "encryptionkey@0"
I20260805 22:53:45.317358 24215 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260805 22:53:45.321215 24236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:45.322700 24215 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:53:45.322960 24215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "6a8a27a3279a4b6a980386d3bec2316b"
format_stamp: "Formatted at 2026-08-05 22:53:45 on dist-test-slave-gmjp"
server_key: "b5e55f65b9459155ea3f2dd89d06c356"
server_key_iv: "7cdbdb23c10600500fb01dce789ee3f1"
server_key_version: "encryptionkey@0"
I20260805 22:53:45.323225 24215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:45.338254 24215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:45.343207 24215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:45.343554 24215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:45.364049 24215 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:45599
I20260805 22:53:45.364073 24318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:45599 every 8 connection(s)
I20260805 22:53:45.365700 24215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:53:45.369794 24319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:45.375260 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 24215
I20260805 22:53:45.375525 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:53:45.376231 20617 external_mini_cluster.cc:1428] Setting key 9fcf754f936fbb7fc01507f2b72ce97c
I20260805 22:53:45.381597 24319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b: Bootstrap starting.
I20260805 22:53:45.385711 24319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:45.387068 24319 log.cc:824] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:45.391093 24319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b: No bootstrap required, opened a new log
Aug 05 22:53:45 dist-test-slave-gmjp krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:45.399461 24319 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8a27a3279a4b6a980386d3bec2316b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45599 } }
I20260805 22:53:45.399884 24319 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:45.400029 24319 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a8a27a3279a4b6a980386d3bec2316b, State: Initialized, Role: FOLLOWER
I20260805 22:53:45.400871 24319 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8a27a3279a4b6a980386d3bec2316b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45599 } }
I20260805 22:53:45.401162 24319 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:53:45.401328 24319 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:53:45.401517 24319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:45.401808 24322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:45.378376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58766 (local address 127.20.34.126:45599)
0805 22:53:45.379326 (+ 950us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:45.379338 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:45.379385 (+ 47us) server_negotiation.cc:407] Connection header received
0805 22:53:45.381211 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:45.381243 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:45.381646 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:45.382019 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:45.383952 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:45.385356 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:45.387300 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:45.388528 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:45.388738 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:45.393799 (+ 5061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:45.393811 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:45.393827 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:45.393871 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:45.397222 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:45.397980 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:45.397987 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:45.398035 (+ 48us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:45.398254 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:45.398669 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:45.398675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:45.398678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:45.399255 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:45.399580 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:45.400055 (+ 475us) server_negotiation.cc:299] Negotiation successful
0805 22:53:45.400551 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":460,"threads_started":1}
I20260805 22:53:45.404553 24319 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8a27a3279a4b6a980386d3bec2316b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45599 } }
I20260805 22:53:45.405189 24319 leader_election.cc:302] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a8a27a3279a4b6a980386d3bec2316b; no voters:
I20260805 22:53:45.405885 24319 leader_election.cc:288] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:53:45.406044 24324 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:45.406787 24324 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [term 1 LEADER]: Becoming Leader. State: Replica: 6a8a27a3279a4b6a980386d3bec2316b, State: Running, Role: LEADER
I20260805 22:53:45.407330 24324 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8a27a3279a4b6a980386d3bec2316b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45599 } }
I20260805 22:53:45.408213 24319 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:53:45.410511 24325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a8a27a3279a4b6a980386d3bec2316b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8a27a3279a4b6a980386d3bec2316b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45599 } } }
I20260805 22:53:45.410485 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a8a27a3279a4b6a980386d3bec2316b. Latest consensus state: current_term: 1 leader_uuid: "6a8a27a3279a4b6a980386d3bec2316b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a8a27a3279a4b6a980386d3bec2316b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45599 } } }
I20260805 22:53:45.411445 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:45.416213 24325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:45.421262 24336 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:53:45.425904 24336 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:53:45.434576 24336 catalog_manager.cc:1347] Generated new cluster ID: b6a1076c945c4022b104882102d513da
I20260805 22:53:45.434743 24336 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:53:45.461059 24336 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:53:45.463339 24336 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:53:45.471715 24336 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a8a27a3279a4b6a980386d3bec2316b: Generated new TSK 0
I20260805 22:53:45.472918 24336 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:53:45.536613 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45599
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:45.925005 24350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:45.925312 24350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:45.925472 24350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:45.933280 24350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:45.933404 24350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:45.933573 24350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:53:45.943944 24350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:45.945441 24350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:45.946837 24350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:45.961303 24362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:45.961206 24363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:45.961256 24366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:45.962222 24350 server_base.cc:1034] running on GCE node
I20260805 22:53:45.962904 24350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:45.963938 24350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:45.965155 24350 hybrid_clock.cc:648] HybridClock initialized: now 1785970425965087 us; error 54 us; skew 500 ppm
I20260805 22:53:45.965476 24350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:45 dist-test-slave-gmjp krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970425, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:45.969175 24350 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:53:45.971063 24350 webserver.cc:460] Webserver started at http://127.20.34.65:34923/ using document root <none> and password file <none>
I20260805 22:53:45.971948 24350 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:45.972111 24350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:45.972535 24350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:45.975759 24350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "53fc2032bdbc41bca5c688284a1aa1cd"
format_stamp: "Formatted at 2026-08-05 22:53:45 on dist-test-slave-gmjp"
server_key: "2eb3813048557ff893ff2932ee14d20f"
server_key_iv: "9738fabc910829a4d90f12e68a5bf119"
server_key_version: "encryptionkey@0"
I20260805 22:53:45.976634 24350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "53fc2032bdbc41bca5c688284a1aa1cd"
format_stamp: "Formatted at 2026-08-05 22:53:45 on dist-test-slave-gmjp"
server_key: "2eb3813048557ff893ff2932ee14d20f"
server_key_iv: "9738fabc910829a4d90f12e68a5bf119"
server_key_version: "encryptionkey@0"
I20260805 22:53:45.982357 24350 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:53:45.986249 24374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:45.987931 24350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:53:45.988158 24350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "53fc2032bdbc41bca5c688284a1aa1cd"
format_stamp: "Formatted at 2026-08-05 22:53:45 on dist-test-slave-gmjp"
server_key: "2eb3813048557ff893ff2932ee14d20f"
server_key_iv: "9738fabc910829a4d90f12e68a5bf119"
server_key_version: "encryptionkey@0"
I20260805 22:53:45.988463 24350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:46.013657 24350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:46.018388 24350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:46.018738 24350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:46.019865 24350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:46.021426 24350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:46.021543 24350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:46.021699 24350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:46.021785 24350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:46.058369 24350 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34771
I20260805 22:53:46.058494 24526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34771 every 8 connection(s)
I20260805 22:53:46.059809 24350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:53:46.066154 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 24350
I20260805 22:53:46.066439 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:53:46.067128 20617 external_mini_cluster.cc:1428] Setting key 0499ab1a627f55d2b9d50318c43ef825
Aug 05 22:53:46 dist-test-slave-gmjp krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970425, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:46.081797 24532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:46.062612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:37387 (local address 127.20.34.126:45599)
0805 22:53:46.063088 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:46.063093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:46.064131 (+ 1038us) server_negotiation.cc:407] Connection header received
0805 22:53:46.066110 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:46.066115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:46.066212 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:46.066335 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:46.068086 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:46.068921 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:46.070574 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:46.071007 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:46.071153 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:46.074987 (+ 3834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:46.074992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:46.074996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:46.075030 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:46.078138 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:46.078947 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:46.078956 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:46.078962 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:46.079131 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:46.079575 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:46.079583 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:46.079589 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:46.080020 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:46.080206 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:46.080991 (+ 785us) server_negotiation.cc:299] Negotiation successful
0805 22:53:46.081257 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":243,"threads_started":1}
I20260805 22:53:46.082543 24534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:46.063214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45599 (local address 127.20.34.65:37387)
0805 22:53:46.063957 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:46.063996 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:46.065827 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:46.066692 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:46.066700 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:46.067250 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:46.067903 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:46.067924 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:46.069106 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:46.069110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:46.070401 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:46.070415 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:46.071290 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:46.071306 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:46.071551 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:46.072362 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:46.072387 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:46.074720 (+ 2333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:46.078303 (+ 3583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:46.078310 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:46.078327 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:46.078806 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:46.079247 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:46.079250 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:46.079252 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:46.079461 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:46.080202 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:46.080216 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:46.080577 (+ 361us) client_negotiation.cc:769] Sending connection context
0805 22:53:46.080837 (+ 260us) client_negotiation.cc:240] Negotiation successful
0805 22:53:46.081271 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":285,"threads_started":1}
I20260805 22:53:46.084287 24528 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45599
I20260805 22:53:46.084681 24528 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:46.085647 24528 heartbeater.cc:511] Master 127.20.34.126:45599 requested a full tablet report, sending...
I20260805 22:53:46.088438 24259 ts_manager.cc:194] Registered new tserver with Master: 53fc2032bdbc41bca5c688284a1aa1cd (127.20.34.65:34771)
I20260805 22:53:46.089995 24259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:37387
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:53:46.127411 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45599
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:46.493526 24540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:46.493873 24540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:46.494046 24540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:46.501736 24540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:46.501878 24540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:46.502079 24540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:53:46.512876 24540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:46.514320 24540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:46.515686 24540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:46.529822 24554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:46.529822 24551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:46.529822 24550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:46.531028 24540 server_base.cc:1034] running on GCE node
I20260805 22:53:46.531795 24540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:46.533012 24540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:46.534265 24540 hybrid_clock.cc:648] HybridClock initialized: now 1785970426534207 us; error 44 us; skew 500 ppm
I20260805 22:53:46.534638 24540 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:46 dist-test-slave-gmjp krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970426, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:46.538267 24540 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:53:46.540030 24540 webserver.cc:460] Webserver started at http://127.20.34.66:38101/ using document root <none> and password file <none>
I20260805 22:53:46.540830 24540 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:46.540992 24540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:46.541339 24540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:46.544570 24540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "7594104f4ae34db49bc18931b66dae4b"
format_stamp: "Formatted at 2026-08-05 22:53:46 on dist-test-slave-gmjp"
server_key: "29927db804f6d99e2d39d021593269d0"
server_key_iv: "01c8ae9f890982a0b44f41e3b4cee308"
server_key_version: "encryptionkey@0"
I20260805 22:53:46.545423 24540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "7594104f4ae34db49bc18931b66dae4b"
format_stamp: "Formatted at 2026-08-05 22:53:46 on dist-test-slave-gmjp"
server_key: "29927db804f6d99e2d39d021593269d0"
server_key_iv: "01c8ae9f890982a0b44f41e3b4cee308"
server_key_version: "encryptionkey@0"
I20260805 22:53:46.550863 24540 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260805 22:53:46.554741 24561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:46.556484 24540 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 22:53:46.556689 24540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "7594104f4ae34db49bc18931b66dae4b"
format_stamp: "Formatted at 2026-08-05 22:53:46 on dist-test-slave-gmjp"
server_key: "29927db804f6d99e2d39d021593269d0"
server_key_iv: "01c8ae9f890982a0b44f41e3b4cee308"
server_key_version: "encryptionkey@0"
I20260805 22:53:46.556938 24540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:46.572402 24540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:46.577193 24540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:46.577533 24540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:46.578604 24540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:46.580116 24540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:46.580251 24540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 22:53:46.580410 24540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:46.580488 24540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:46.615221 24540 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:43191
I20260805 22:53:46.615262 24714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:43191 every 8 connection(s)
I20260805 22:53:46.616672 24540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:53:46.624364 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 24540
I20260805 22:53:46.624580 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:53:46.625054 20617 external_mini_cluster.cc:1428] Setting key 03b857922edcf3b40713fa0b731843fa
Aug 05 22:53:46 dist-test-slave-gmjp krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970426, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:46.641351 24717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:46.619541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:52649 (local address 127.20.34.126:45599)
0805 22:53:46.620054 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:46.620061 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:46.621360 (+ 1299us) server_negotiation.cc:407] Connection header received
0805 22:53:46.623302 (+ 1942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:46.623307 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:46.623381 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:46.623492 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:46.625362 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:46.626369 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:46.628582 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:46.629370 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:46.629530 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:46.633584 (+ 4054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:46.633593 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:46.633602 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:46.633653 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:46.637401 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:46.638661 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:46.638666 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:46.638669 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:46.638823 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:46.639399 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:46.639402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:46.639404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:46.639687 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:46.639806 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:46.640862 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0805 22:53:46.641058 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":252,"threads_started":1}
I20260805 22:53:46.643038 24719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:46.620227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45599 (local address 127.20.34.66:52649)
0805 22:53:46.621143 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:46.621201 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:46.622998 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:46.623720 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:46.623729 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:46.624392 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:46.625133 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:46.625162 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:46.626575 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:46.626581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:46.628392 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:46.628405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:46.629611 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:46.629616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:46.629845 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:46.630603 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:46.630630 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:46.633289 (+ 2659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:46.637603 (+ 4314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:46.637616 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:46.637640 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:46.638482 (+ 842us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:46.638955 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:46.638963 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:46.638969 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:46.639265 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:46.639827 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:46.639839 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:46.640396 (+ 557us) client_negotiation.cc:769] Sending connection context
0805 22:53:46.640724 (+ 328us) client_negotiation.cc:240] Negotiation successful
0805 22:53:46.641372 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":378,"threads_started":1}
I20260805 22:53:46.644981 24715 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45599
I20260805 22:53:46.645371 24715 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:46.646203 24715 heartbeater.cc:511] Master 127.20.34.126:45599 requested a full tablet report, sending...
I20260805 22:53:46.647998 24259 ts_manager.cc:194] Registered new tserver with Master: 7594104f4ae34db49bc18931b66dae4b (127.20.34.66:43191)
I20260805 22:53:46.649451 24259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:52649
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:53:46.688120 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45599
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:47.043188 24722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:47.043514 24722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:47.043617 24722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:47.051045 24722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:47.051169 24722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:47.051287 24722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:53:47.062363 24722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:47.063653 24722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:47.065075 24722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:47.079754 24730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:47.079644 24729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:47.080327 24735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:47.080991 24722 server_base.cc:1034] running on GCE node
I20260805 22:53:47.081766 24722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:47.082866 24722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:47.084115 24722 hybrid_clock.cc:648] HybridClock initialized: now 1785970427084043 us; error 67 us; skew 500 ppm
I20260805 22:53:47.084527 24722 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:47 dist-test-slave-gmjp krb5kdc[24197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970427, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:47.088065 24722 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:53:47.090054 24722 webserver.cc:460] Webserver started at http://127.20.34.67:43853/ using document root <none> and password file <none>
I20260805 22:53:47.090857 24722 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:47.091023 24722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:47.091367 24722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:47.093952 24528 heartbeater.cc:503] Master 127.20.34.126:45599 was elected leader, sending a full tablet report...
I20260805 22:53:47.095157 24722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "b0614e578a704b86840821cf19fd293b"
format_stamp: "Formatted at 2026-08-05 22:53:47 on dist-test-slave-gmjp"
server_key: "a884313d6f2f0aa6fdebcac62cd4d0a1"
server_key_iv: "76dbc9fddd3e7db07548433ad04bfd75"
server_key_version: "encryptionkey@0"
I20260805 22:53:47.096375 24722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "b0614e578a704b86840821cf19fd293b"
format_stamp: "Formatted at 2026-08-05 22:53:47 on dist-test-slave-gmjp"
server_key: "a884313d6f2f0aa6fdebcac62cd4d0a1"
server_key_iv: "76dbc9fddd3e7db07548433ad04bfd75"
server_key_version: "encryptionkey@0"
I20260805 22:53:47.102249 24722 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:53:47.106614 24744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:47.108309 24722 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:53:47.108570 24722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "b0614e578a704b86840821cf19fd293b"
format_stamp: "Formatted at 2026-08-05 22:53:47 on dist-test-slave-gmjp"
server_key: "a884313d6f2f0aa6fdebcac62cd4d0a1"
server_key_iv: "76dbc9fddd3e7db07548433ad04bfd75"
server_key_version: "encryptionkey@0"
I20260805 22:53:47.108804 24722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:47.133169 24722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:47.138208 24722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:47.138564 24722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:47.139698 24722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:47.141321 24722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:47.141412 24722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:47.141584 24722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:47.141636 24722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:47.178243 24722 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:34577
I20260805 22:53:47.178355 24909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:34577 every 8 connection(s)
I20260805 22:53:47.179649 24722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:53:47.185621 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 24722
I20260805 22:53:47.185858 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:53:47.186497 20617 external_mini_cluster.cc:1428] Setting key 82ae1b174505208cd7c1e0ec06fefa8b
Aug 05 22:53:47 dist-test-slave-gmjp krb5kdc[24197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970427, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:47.204139 24912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:47.182792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:37265 (local address 127.20.34.126:45599)
0805 22:53:47.183443 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:47.183449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:47.184595 (+ 1146us) server_negotiation.cc:407] Connection header received
0805 22:53:47.187655 (+ 3060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:47.187661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:47.187781 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:47.187915 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:47.190542 (+ 2627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:47.191955 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:47.193780 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:47.194186 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:47.194289 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:47.197917 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:47.197923 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:47.197926 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:47.197961 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:47.200638 (+ 2677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:47.201425 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:47.201429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:47.201432 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:47.201593 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:47.202059 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:47.202064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:47.202068 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:47.202494 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:47.202668 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:47.203572 (+ 904us) server_negotiation.cc:299] Negotiation successful
0805 22:53:47.203853 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":293,"threads_started":1}
I20260805 22:53:47.205315 24913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:47.183411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45599 (local address 127.20.34.67:37265)
0805 22:53:47.184377 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:47.184462 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:47.187144 (+ 2682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:47.188459 (+ 1315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:47.188477 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:47.189354 (+ 877us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:47.190310 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:47.190349 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:47.192193 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:47.192199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:47.193637 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:47.193651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:47.194392 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:47.194397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:47.194641 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:47.195303 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:47.195328 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:47.197667 (+ 2339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:47.200778 (+ 3111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:47.200787 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:47.200801 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:47.201266 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:47.201718 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:47.201721 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:47.201724 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:47.201930 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:47.202632 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:47.202638 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:47.203122 (+ 484us) client_negotiation.cc:769] Sending connection context
0805 22:53:47.203445 (+ 323us) client_negotiation.cc:240] Negotiation successful
0805 22:53:47.204013 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":331,"threads_started":1}
I20260805 22:53:47.206797 24910 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45599
I20260805 22:53:47.207136 24910 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:47.207892 24910 heartbeater.cc:511] Master 127.20.34.126:45599 requested a full tablet report, sending...
I20260805 22:53:47.209496 24259 ts_manager.cc:194] Registered new tserver with Master: b0614e578a704b86840821cf19fd293b (127.20.34.67:34577)
I20260805 22:53:47.210403 24259 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:37265
I20260805 22:53:47.215831 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 22:53:47.262445 24912 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:53:47.259356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58778 (local address 127.20.34.126:45599)
0805 22:53:47.259548 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:47.259553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:47.260077 (+ 524us) server_negotiation.cc:407] Connection header received
0805 22:53:47.260395 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:47.260399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:47.260477 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:47.260601 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:47.262113 (+ 1512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58778: BlockingRecv error: recv got EOF from 127.0.0.1:58778 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 22:53:47.265846 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 24350
W20260805 22:53:47.268855 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 24350: Not authorized: Client connection negotiation failed: client connection to 127.20.34.65:34771: server requires authentication, but client does not have Kerberos credentials available
I20260805 22:53:47.269091 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 24350
I20260805 22:53:47.294682 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 24540
W20260805 22:53:47.297775 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 24540: Not authorized: Client connection negotiation failed: client connection to 127.20.34.66:43191: server requires authentication, but client does not have Kerberos credentials available
I20260805 22:53:47.297986 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 24540
I20260805 22:53:47.326218 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 24722
W20260805 22:53:47.329902 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 24722: Not authorized: Client connection negotiation failed: client connection to 127.20.34.67:34577: server requires authentication, but client does not have Kerberos credentials available
I20260805 22:53:47.330046 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 24722
I20260805 22:53:47.351682 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 24215
I20260805 22:53:47.353097 24314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:47.466151 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 24215
2026-08-05T22:53:47Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4147 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:47 dist-test-slave-gmjp krb5kdc[24940](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:47 dist-test-slave-gmjp krb5kdc[24940](info): set up 2 sockets
Aug 05 22:53:47 dist-test-slave-gmjp krb5kdc[24940](info): commencing operation
krb5kdc: starting...
W20260805 22:53:48.777318 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:53:48 dist-test-slave-gmjp krb5kdc[24940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:53:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:53:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:53:49.044499 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:44773
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:41767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:44773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:49.411438 24958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:49.411763 24958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:49.411953 24958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:49.419406 24958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:53:49.419543 24958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:49.419647 24958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:49.419730 24958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:53:49.419831 24958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:53:49.430187 24958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:44773
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:44773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:49.431612 24958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:49.433046 24958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:49.445734 24964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:49.445701 24966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:49.445771 24968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:49.446429 24958 server_base.cc:1034] running on GCE node
I20260805 22:53:49.447343 24958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:49.448886 24958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:49.450100 24958 hybrid_clock.cc:648] HybridClock initialized: now 1785970429450048 us; error 45 us; skew 500 ppm
I20260805 22:53:49.450431 24958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:49 dist-test-slave-gmjp krb5kdc[24940](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970429, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:49.456943 24958 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:53:49.458851 24958 webserver.cc:460] Webserver started at http://127.20.34.126:41195/ using document root <none> and password file <none>
I20260805 22:53:49.459672 24958 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:49.459822 24958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:49.460242 24958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:49.463565 24958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "3756a8f9934b4f5cadd0dedbd57d07ad"
format_stamp: "Formatted at 2026-08-05 22:53:49 on dist-test-slave-gmjp"
server_key: "7b2a861ee3dc7523a82238d6bebeee0d"
server_key_iv: "cf83542a4dcd306e6af8a248927d030a"
server_key_version: "encryptionkey@0"
I20260805 22:53:49.464511 24958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "3756a8f9934b4f5cadd0dedbd57d07ad"
format_stamp: "Formatted at 2026-08-05 22:53:49 on dist-test-slave-gmjp"
server_key: "7b2a861ee3dc7523a82238d6bebeee0d"
server_key_iv: "cf83542a4dcd306e6af8a248927d030a"
server_key_version: "encryptionkey@0"
I20260805 22:53:49.470101 24958 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:53:49.473922 24977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:49.475360 24958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:53:49.475558 24958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "3756a8f9934b4f5cadd0dedbd57d07ad"
format_stamp: "Formatted at 2026-08-05 22:53:49 on dist-test-slave-gmjp"
server_key: "7b2a861ee3dc7523a82238d6bebeee0d"
server_key_iv: "cf83542a4dcd306e6af8a248927d030a"
server_key_version: "encryptionkey@0"
I20260805 22:53:49.475844 24958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:49.492100 24958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:49.497159 24958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:49.497488 24958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:49.518401 24958 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:44773
I20260805 22:53:49.518455 25048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:44773 every 8 connection(s)
I20260805 22:53:49.519959 24958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:53:49.521541 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 24958
I20260805 22:53:49.521840 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:53:49.522710 20617 external_mini_cluster.cc:1428] Setting key 5100ac34c9f65f09820812fc9494c427
I20260805 22:53:49.525359 25049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 22:53:49 dist-test-slave-gmjp krb5kdc[24940](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:49.539077 25049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad: Bootstrap starting.
I20260805 22:53:49.542477 25049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:49.543560 25049 log.cc:824] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:49.546608 25049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad: No bootstrap required, opened a new log
I20260805 22:53:49.546936 25054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:49.524801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50000 (local address 127.20.34.126:44773)
0805 22:53:49.525689 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:49.525702 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:49.525747 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:53:49.527419 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:49.527442 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:49.527850 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:49.528280 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:49.530137 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:49.531507 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:49.533368 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:49.534107 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:49.534271 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:49.539162 (+ 4891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:49.539170 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:49.539185 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:49.539272 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:49.542499 (+ 3227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:49.543256 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:49.543263 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:49.543270 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:49.543452 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:49.543919 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:49.543924 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:49.543926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:49.544572 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:49.544916 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:49.545460 (+ 544us) server_negotiation.cc:299] Negotiation successful
0805 22:53:49.545882 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":408,"threads_started":1}
I20260805 22:53:49.551569 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:53:49.555395 25049 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3756a8f9934b4f5cadd0dedbd57d07ad" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44773 } }
I20260805 22:53:49.555866 25049 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:49.555989 25049 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3756a8f9934b4f5cadd0dedbd57d07ad, State: Initialized, Role: FOLLOWER
I20260805 22:53:49.556742 25049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3756a8f9934b4f5cadd0dedbd57d07ad" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44773 } }
I20260805 22:53:49.557024 25049 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:53:49.557190 25049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:53:49.557387 25049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:49.559718 25049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3756a8f9934b4f5cadd0dedbd57d07ad" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44773 } }
I20260805 22:53:49.560343 25049 leader_election.cc:302] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3756a8f9934b4f5cadd0dedbd57d07ad; no voters:
I20260805 22:53:49.561074 25049 leader_election.cc:288] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:53:49.561198 25057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:49.562577 25057 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [term 1 LEADER]: Becoming Leader. State: Replica: 3756a8f9934b4f5cadd0dedbd57d07ad, State: Running, Role: LEADER
I20260805 22:53:49.563256 25057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3756a8f9934b4f5cadd0dedbd57d07ad" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44773 } }
I20260805 22:53:49.563822 25049 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:53:49.566427 25059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3756a8f9934b4f5cadd0dedbd57d07ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3756a8f9934b4f5cadd0dedbd57d07ad" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44773 } } }
I20260805 22:53:49.566936 25059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:49.567953 25060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3756a8f9934b4f5cadd0dedbd57d07ad. Latest consensus state: current_term: 1 leader_uuid: "3756a8f9934b4f5cadd0dedbd57d07ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3756a8f9934b4f5cadd0dedbd57d07ad" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44773 } } }
I20260805 22:53:49.568389 25060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:49.575773 25063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:53:49.583001 25063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:53:49.596264 25063 catalog_manager.cc:1347] Generated new cluster ID: e27aa70325b34aca8cf9777221cdbe77
I20260805 22:53:49.596414 25063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:53:49.612464 25063 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:53:49.613857 25063 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:53:49.618165 25054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:49.606866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50006 (local address 127.20.34.126:44773)
0805 22:53:49.607052 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:49.607059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:49.607694 (+ 635us) server_negotiation.cc:407] Connection header received
0805 22:53:49.607882 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:49.607889 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:49.607981 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:49.608108 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:49.609488 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:49.610683 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:49.614096 (+ 3413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:49.614775 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:49.614948 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:49.616385 (+ 1437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:49.616392 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:49.616397 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:53:49.617234 (+ 837us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:49.617290 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:53:49.617326 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:49.617446 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:49.617621 (+ 175us) server_negotiation.cc:299] Negotiation successful
0805 22:53:49.617761 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 22:53:49.636860 25063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3756a8f9934b4f5cadd0dedbd57d07ad: Generated new TSK 0
I20260805 22:53:49.638024 25063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:53:49.649344 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 24958
I20260805 22:53:49.650755 25042 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:49.746064 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 24958
2026-08-05T22:53:49Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2271 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:49 dist-test-slave-gmjp krb5kdc[25102](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:49 dist-test-slave-gmjp krb5kdc[25102](info): set up 2 sockets
Aug 05 22:53:49 dist-test-slave-gmjp krb5kdc[25102](info): commencing operation
krb5kdc: starting...
W20260805 22:53:51.047324 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:53:51 dist-test-slave-gmjp krb5kdc[25102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:53:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:53:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:53:51.312655 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39381
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:39381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:51.670042 25119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:51.670404 25119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:51.670502 25119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:51.678102 25119 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:53:51.678227 25119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:51.678277 25119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:51.678336 25119 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:53:51.678383 25119 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:53:51.688712 25119 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:39381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:51.690155 25119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:51.691532 25119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:51.705096 25131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:51.705163 25133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:51.705297 25128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:51.706035 25119 server_base.cc:1034] running on GCE node
I20260805 22:53:51.707043 25119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:51.708817 25119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:51.710088 25119 hybrid_clock.cc:648] HybridClock initialized: now 1785970431710043 us; error 56 us; skew 500 ppm
I20260805 22:53:51.710510 25119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:51 dist-test-slave-gmjp krb5kdc[25102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970431, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:51.714080 25119 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:53:51.715773 25119 webserver.cc:460] Webserver started at http://127.20.34.126:42823/ using document root <none> and password file <none>
I20260805 22:53:51.716594 25119 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:51.716770 25119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:51.717129 25119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:51.720574 25119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "a7d55b4271c4403d991319e6b9497ba1"
format_stamp: "Formatted at 2026-08-05 22:53:51 on dist-test-slave-gmjp"
server_key: "eb74cdcba5182dbd7db54196773458cc"
server_key_iv: "b13bd5337a91f6b5b74411cde192d50b"
server_key_version: "encryptionkey@0"
I20260805 22:53:51.721503 25119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "a7d55b4271c4403d991319e6b9497ba1"
format_stamp: "Formatted at 2026-08-05 22:53:51 on dist-test-slave-gmjp"
server_key: "eb74cdcba5182dbd7db54196773458cc"
server_key_iv: "b13bd5337a91f6b5b74411cde192d50b"
server_key_version: "encryptionkey@0"
I20260805 22:53:51.727368 25119 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:53:51.731171 25145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:51.732668 25119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:53:51.732889 25119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "a7d55b4271c4403d991319e6b9497ba1"
format_stamp: "Formatted at 2026-08-05 22:53:51 on dist-test-slave-gmjp"
server_key: "eb74cdcba5182dbd7db54196773458cc"
server_key_iv: "b13bd5337a91f6b5b74411cde192d50b"
server_key_version: "encryptionkey@0"
I20260805 22:53:51.733114 25119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:51.759338 25119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:51.764067 25119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:51.764430 25119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:51.785346 25119 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:39381
I20260805 22:53:51.785403 25220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:39381 every 8 connection(s)
I20260805 22:53:51.786861 25119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:53:51.790263 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 25119
I20260805 22:53:51.790539 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:53:51.791115 25223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:53:51.791249 20617 external_mini_cluster.cc:1428] Setting key c15ee7e18f320797579f6bbc5d1e72e6
Aug 05 22:53:51 dist-test-slave-gmjp krb5kdc[25102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:51.807341 25223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1: Bootstrap starting.
I20260805 22:53:51.810905 25223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:51.812112 25223 log.cc:824] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:51.815382 25223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1: No bootstrap required, opened a new log
I20260805 22:53:51.816654 25228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:51.793411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46512 (local address 127.20.34.126:39381)
0805 22:53:51.794325 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:51.794337 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:51.794382 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:53:51.795974 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:51.795997 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:51.796502 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:51.796852 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:51.798796 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:51.800257 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:51.802257 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:51.803098 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:51.803268 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:51.808519 (+ 5251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:51.808529 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:51.808554 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:51.808600 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:51.811988 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:51.812901 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:51.812913 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:51.812921 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:51.813118 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:51.813551 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:51.813557 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:51.813562 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:51.814162 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:51.814508 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:51.814976 (+ 468us) server_negotiation.cc:299] Negotiation successful
0805 22:53:51.815480 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":403,"threads_started":1}
I20260805 22:53:51.824982 25223 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7d55b4271c4403d991319e6b9497ba1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39381 } }
I20260805 22:53:51.825420 25223 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:51.825573 25223 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7d55b4271c4403d991319e6b9497ba1, State: Initialized, Role: FOLLOWER
I20260805 22:53:51.826332 25223 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7d55b4271c4403d991319e6b9497ba1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39381 } }
I20260805 22:53:51.826601 25223 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:53:51.826784 25223 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:53:51.826974 25223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:51.829905 25223 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7d55b4271c4403d991319e6b9497ba1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39381 } }
I20260805 22:53:51.830535 25223 leader_election.cc:302] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7d55b4271c4403d991319e6b9497ba1; no voters:
I20260805 22:53:51.831216 25223 leader_election.cc:288] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:53:51.831410 25230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:51.832181 25230 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [term 1 LEADER]: Becoming Leader. State: Replica: a7d55b4271c4403d991319e6b9497ba1, State: Running, Role: LEADER
I20260805 22:53:51.832978 25230 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7d55b4271c4403d991319e6b9497ba1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39381 } }
I20260805 22:53:51.833804 25223 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:53:51.836139 25232 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7d55b4271c4403d991319e6b9497ba1. Latest consensus state: current_term: 1 leader_uuid: "a7d55b4271c4403d991319e6b9497ba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7d55b4271c4403d991319e6b9497ba1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39381 } } }
I20260805 22:53:51.836598 25232 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:51.837256 25231 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7d55b4271c4403d991319e6b9497ba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7d55b4271c4403d991319e6b9497ba1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39381 } } }
I20260805 22:53:51.837620 25231 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:51.840098 25241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:53:51.846117 25241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:53:51.855856 25241 catalog_manager.cc:1347] Generated new cluster ID: 433b7f878a1342c9b19e781efa3852cd
I20260805 22:53:51.856024 25241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:53:51.881009 25241 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:53:51.883095 25241 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:53:51.891592 25241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7d55b4271c4403d991319e6b9497ba1: Generated new TSK 0
I20260805 22:53:51.892756 25241 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:53:51.960268 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39381
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:52.332662 25257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:52.332981 25257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:52.333087 25257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:52.342504 25257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:52.342626 25257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:52.342743 25257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:53:52.353302 25257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:52.354701 25257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:52.356199 25257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:52.370115 25266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:52.370059 25267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:52.370087 25269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:52.370985 25257 server_base.cc:1034] running on GCE node
I20260805 22:53:52.371624 25257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:52.372697 25257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:52.373939 25257 hybrid_clock.cc:648] HybridClock initialized: now 1785970432373886 us; error 47 us; skew 500 ppm
I20260805 22:53:52.374296 25257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:52 dist-test-slave-gmjp krb5kdc[25102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970432, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:52.378098 25257 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:53:52.379639 25257 webserver.cc:460] Webserver started at http://127.20.34.65:39223/ using document root <none> and password file <none>
I20260805 22:53:52.380483 25257 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:52.380635 25257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:52.380961 25257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:52.384102 25257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "b269e5d257dc423a8b519a38bab9cf82"
format_stamp: "Formatted at 2026-08-05 22:53:52 on dist-test-slave-gmjp"
server_key: "055f657328bec1c1ec11be72d0eec19b"
server_key_iv: "e6b622f77219c1ac21c8af0724b6e00d"
server_key_version: "encryptionkey@0"
I20260805 22:53:52.385046 25257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "b269e5d257dc423a8b519a38bab9cf82"
format_stamp: "Formatted at 2026-08-05 22:53:52 on dist-test-slave-gmjp"
server_key: "055f657328bec1c1ec11be72d0eec19b"
server_key_iv: "e6b622f77219c1ac21c8af0724b6e00d"
server_key_version: "encryptionkey@0"
I20260805 22:53:52.390847 25257 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:53:52.395190 25284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:52.396852 25257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:53:52.397011 25257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "b269e5d257dc423a8b519a38bab9cf82"
format_stamp: "Formatted at 2026-08-05 22:53:52 on dist-test-slave-gmjp"
server_key: "055f657328bec1c1ec11be72d0eec19b"
server_key_iv: "e6b622f77219c1ac21c8af0724b6e00d"
server_key_version: "encryptionkey@0"
I20260805 22:53:52.397198 25257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:52.435182 25257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:52.440217 25257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:52.440550 25257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:52.441785 25257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:52.443372 25257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:52.443460 25257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:52.443557 25257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:52.443601 25257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:52.479573 25257 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:36805
I20260805 22:53:52.479735 25444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:36805 every 8 connection(s)
I20260805 22:53:52.480993 25257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:53:52.488721 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 25257
I20260805 22:53:52.488941 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:53:52.489634 20617 external_mini_cluster.cc:1428] Setting key 2f754f590294ebebc63b9458fac4ebb1
Aug 05 22:53:52 dist-test-slave-gmjp krb5kdc[25102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970432, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:52.503481 25449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:52.483828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:58553 (local address 127.20.34.126:39381)
0805 22:53:52.484349 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:52.484354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:52.485259 (+ 905us) server_negotiation.cc:407] Connection header received
0805 22:53:52.487200 (+ 1941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:52.487206 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:52.487309 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:52.487438 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:52.489304 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:52.490110 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:52.491981 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:52.492447 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:52.492592 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:52.496580 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:52.496585 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:52.496589 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:52.496624 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:52.499328 (+ 2704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:52.500191 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:52.500199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:52.500202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:52.500357 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:52.500833 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:52.500838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:52.500841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:52.501241 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:52.501405 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:52.502546 (+ 1141us) server_negotiation.cc:299] Negotiation successful
0805 22:53:52.502875 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":271,"threads_started":1}
I20260805 22:53:52.504123 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:52.484355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39381 (local address 127.20.34.65:58553)
0805 22:53:52.485082 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:52.485122 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:52.486893 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:52.487706 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:52.487715 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:52.488373 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:52.489095 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:52.489118 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:52.490273 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:52.490278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:52.491829 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:52.491844 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:52.492689 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:52.492698 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:52.492944 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:52.493668 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:52.493692 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:52.496321 (+ 2629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:52.499509 (+ 3188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:52.499519 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:52.499541 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:52.500028 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:52.500481 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:52.500486 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:52.500490 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:52.500703 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:52.501411 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:52.501422 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:52.501971 (+ 549us) client_negotiation.cc:769] Sending connection context
0805 22:53:52.502339 (+ 368us) client_negotiation.cc:240] Negotiation successful
0805 22:53:52.502845 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":301,"threads_started":1}
I20260805 22:53:52.506052 25445 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39381
I20260805 22:53:52.506412 25445 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:52.507285 25445 heartbeater.cc:511] Master 127.20.34.126:39381 requested a full tablet report, sending...
I20260805 22:53:52.509692 25166 ts_manager.cc:194] Registered new tserver with Master: b269e5d257dc423a8b519a38bab9cf82 (127.20.34.65:36805)
I20260805 22:53:52.511219 25166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:58553
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:53:52.551198 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39381
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:52.920909 25455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:52.921263 25455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:52.921442 25455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:52.928959 25455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:52.929134 25455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:52.929332 25455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:53:52.941030 25455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:52.942530 25455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:52.943967 25455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:52.958276 25467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:52.958002 25463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:52.958757 25464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:52.959841 25455 server_base.cc:1034] running on GCE node
I20260805 22:53:52.960616 25455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:52.961666 25455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:52.962908 25455 hybrid_clock.cc:648] HybridClock initialized: now 1785970432962870 us; error 46 us; skew 500 ppm
I20260805 22:53:52.963263 25455 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:52 dist-test-slave-gmjp krb5kdc[25102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970432, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:52.966686 25455 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:53:52.968350 25455 webserver.cc:460] Webserver started at http://127.20.34.66:45533/ using document root <none> and password file <none>
I20260805 22:53:52.969095 25455 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:52.969262 25455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:52.969615 25455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:52.973142 25455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "9365414831804f078473008abb995f77"
format_stamp: "Formatted at 2026-08-05 22:53:52 on dist-test-slave-gmjp"
server_key: "ace4910f5ddd5bb1c2824cdc8a372282"
server_key_iv: "9d4591a1d6290cc3c21297aa27af82c9"
server_key_version: "encryptionkey@0"
I20260805 22:53:52.974099 25455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "9365414831804f078473008abb995f77"
format_stamp: "Formatted at 2026-08-05 22:53:52 on dist-test-slave-gmjp"
server_key: "ace4910f5ddd5bb1c2824cdc8a372282"
server_key_iv: "9d4591a1d6290cc3c21297aa27af82c9"
server_key_version: "encryptionkey@0"
I20260805 22:53:52.980016 25455 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260805 22:53:52.984342 25476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:52.986083 25455 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:53:52.986264 25455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "9365414831804f078473008abb995f77"
format_stamp: "Formatted at 2026-08-05 22:53:52 on dist-test-slave-gmjp"
server_key: "ace4910f5ddd5bb1c2824cdc8a372282"
server_key_iv: "9d4591a1d6290cc3c21297aa27af82c9"
server_key_version: "encryptionkey@0"
I20260805 22:53:52.986486 25455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:52.999958 25455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:53.005465 25455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:53.005771 25455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:53.006875 25455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:53.008559 25455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:53.008646 25455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:53.008751 25455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:53.008801 25455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:53.048333 25455 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:40731
I20260805 22:53:53.048386 25637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:40731 every 8 connection(s)
I20260805 22:53:53.049867 25455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:53:53.059765 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 25455
I20260805 22:53:53.060009 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:53:53.060532 20617 external_mini_cluster.cc:1428] Setting key 86cebb2577f7719be8a866f6a01d08a8
Aug 05 22:53:53 dist-test-slave-gmjp krb5kdc[25102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970432, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:53.072793 25641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:53.052874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:55847 (local address 127.20.34.126:39381)
0805 22:53:53.053420 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:53.053427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:53.054386 (+ 959us) server_negotiation.cc:407] Connection header received
0805 22:53:53.056561 (+ 2175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:53.056566 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:53.056643 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:53.056748 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:53.058489 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.059237 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.061131 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.061628 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.061738 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:53.066068 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:53.066074 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:53.066078 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:53.066117 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:53.069123 (+ 3006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.070082 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.070087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.070089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.070241 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.070764 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.070768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.070770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.071071 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:53.071245 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:53.072055 (+ 810us) server_negotiation.cc:299] Negotiation successful
0805 22:53:53.072380 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":261,"threads_started":1}
I20260805 22:53:53.073904 25642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:53.053397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39381 (local address 127.20.34.66:55847)
0805 22:53:53.054197 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:53.054249 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:53.056173 (+ 1924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:53.057003 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:53.057012 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:53.057622 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:53.058272 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:53.058293 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.059413 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.059417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:53.060952 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:53.060967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.062034 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.062039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:53.062256 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:53.063026 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:53.063050 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:53.065739 (+ 2689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:53.069326 (+ 3587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:53.069337 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:53.069360 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:53.069913 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:53.070377 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:53.070383 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:53.070387 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:53.070621 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:53.071226 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:53.071235 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:53.071646 (+ 411us) client_negotiation.cc:769] Sending connection context
0805 22:53:53.071950 (+ 304us) client_negotiation.cc:240] Negotiation successful
0805 22:53:53.072609 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":300,"threads_started":1}
I20260805 22:53:53.075802 25638 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39381
I20260805 22:53:53.076246 25638 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:53.077149 25638 heartbeater.cc:511] Master 127.20.34.126:39381 requested a full tablet report, sending...
I20260805 22:53:53.078860 25166 ts_manager.cc:194] Registered new tserver with Master: 9365414831804f078473008abb995f77 (127.20.34.66:40731)
I20260805 22:53:53.079721 25166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:55847
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:53:53.120536 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39381
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:53.489063 25645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:53.489362 25645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:53.489462 25645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:53.497262 25645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:53.497378 25645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:53.497495 25645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:53:53.507972 25645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39381
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:53.509459 25645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:53.510932 25645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:53:53.514633 25445 heartbeater.cc:503] Master 127.20.34.126:39381 was elected leader, sending a full tablet report...
W20260805 22:53:53.525970 25650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:53.526012 25651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:53.525970 25654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:53.527418 25645 server_base.cc:1034] running on GCE node
I20260805 22:53:53.528106 25645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:53.529160 25645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:53.530407 25645 hybrid_clock.cc:648] HybridClock initialized: now 1785970433530341 us; error 60 us; skew 500 ppm
I20260805 22:53:53.530752 25645 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:53 dist-test-slave-gmjp krb5kdc[25102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970433, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:53.534072 25645 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:53:53.535694 25645 webserver.cc:460] Webserver started at http://127.20.34.67:41539/ using document root <none> and password file <none>
I20260805 22:53:53.536522 25645 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:53.536677 25645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:53.537096 25645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:53.540413 25645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "80ad984aab404416a10881c749afe396"
format_stamp: "Formatted at 2026-08-05 22:53:53 on dist-test-slave-gmjp"
server_key: "c40cb581af0b70f693252bebe9e54bdf"
server_key_iv: "728af78ef2dd0b6cf706e59bd1d59549"
server_key_version: "encryptionkey@0"
I20260805 22:53:53.541260 25645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "80ad984aab404416a10881c749afe396"
format_stamp: "Formatted at 2026-08-05 22:53:53 on dist-test-slave-gmjp"
server_key: "c40cb581af0b70f693252bebe9e54bdf"
server_key_iv: "728af78ef2dd0b6cf706e59bd1d59549"
server_key_version: "encryptionkey@0"
I20260805 22:53:53.546938 25645 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:53:53.550841 25662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:53.552461 25645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 22:53:53.552608 25645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "80ad984aab404416a10881c749afe396"
format_stamp: "Formatted at 2026-08-05 22:53:53 on dist-test-slave-gmjp"
server_key: "c40cb581af0b70f693252bebe9e54bdf"
server_key_iv: "728af78ef2dd0b6cf706e59bd1d59549"
server_key_version: "encryptionkey@0"
I20260805 22:53:53.552786 25645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:53.577438 25645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:53.582020 25645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:53.582372 25645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:53.583429 25645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:53.584950 25645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:53.585063 25645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:53.585217 25645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:53.585294 25645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:53.621405 25645 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:36887
I20260805 22:53:53.621464 25828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:36887 every 8 connection(s)
I20260805 22:53:53.622810 25645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:53:53.629284 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 25645
I20260805 22:53:53.629520 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:53:53.630240 20617 external_mini_cluster.cc:1428] Setting key ee269fab85215adcb90f01c1c3cf61f5
Aug 05 22:53:53 dist-test-slave-gmjp krb5kdc[25102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970433, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:53.646888 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:53.625876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:49449 (local address 127.20.34.126:39381)
0805 22:53:53.626520 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:53.626528 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:53.627486 (+ 958us) server_negotiation.cc:407] Connection header received
0805 22:53:53.630432 (+ 2946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:53.630439 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:53.630530 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:53.630629 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:53.633017 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.634079 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.635876 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.636411 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.636566 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:53.640542 (+ 3976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:53.640547 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:53.640551 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:53.640596 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:53.643350 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.644140 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.644144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.644146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.644323 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.644789 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.644795 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.644798 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.645222 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:53.645436 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:53.646286 (+ 850us) server_negotiation.cc:299] Negotiation successful
0805 22:53:53.646527 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":352,"threads_started":1}
I20260805 22:53:53.648007 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:53.626302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39381 (local address 127.20.34.67:49449)
0805 22:53:53.627284 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:53.627340 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:53.629925 (+ 2585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:53.631030 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:53.631041 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:53.631833 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:53.632812 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:53.632838 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.634277 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.634287 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:53.635693 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:53.635711 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.636680 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.636688 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:53.636987 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:53.637824 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:53.637850 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:53.640322 (+ 2472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:53.643518 (+ 3196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:53.643526 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:53.643541 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:53.644015 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:53.644425 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:53.644429 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:53.644431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:53.644645 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:53.645419 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:53.645427 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:53.645863 (+ 436us) client_negotiation.cc:769] Sending connection context
0805 22:53:53.646177 (+ 314us) client_negotiation.cc:240] Negotiation successful
0805 22:53:53.646769 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":395,"threads_started":1}
I20260805 22:53:53.649457 25829 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39381
I20260805 22:53:53.649788 25829 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:53.650574 25829 heartbeater.cc:511] Master 127.20.34.126:39381 requested a full tablet report, sending...
I20260805 22:53:53.652056 25166 ts_manager.cc:194] Registered new tserver with Master: 80ad984aab404416a10881c749afe396 (127.20.34.67:36887)
I20260805 22:53:53.652925 25166 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:49449
I20260805 22:53:53.659636 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:53:53 dist-test-slave-gmjp krb5kdc[25102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970433, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 05 22:53:53 dist-test-slave-gmjp krb5kdc[25102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970433, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:53.724025 25832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:53.707492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40192 (local address 127.20.34.126:39381)
0805 22:53:53.707683 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:53.707688 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:53.708368 (+ 680us) server_negotiation.cc:407] Connection header received
0805 22:53:53.708588 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:53.708593 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:53.708676 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:53.708776 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:53.710312 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.711097 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.712491 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.713012 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.713123 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:53.718023 (+ 4900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:53.718029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:53.718032 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:53.718075 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:53.721094 (+ 3019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.721842 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.721847 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.721849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.722000 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.722458 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.722462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.722464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.722811 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:53.723091 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:53.723437 (+ 346us) server_negotiation.cc:299] Negotiation successful
0805 22:53:53.723691 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260805 22:53:53.724704 25166 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40192
I20260805 22:53:53.726876 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 25257
Aug 05 22:53:53 dist-test-slave-gmjp krb5kdc[25102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970433, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:53.744099 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:53.727938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35862 (local address 127.20.34.65:36805)
0805 22:53:53.728636 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:53.728643 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:53.728669 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:53:53.728730 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:53.728737 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:53.728978 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:53.729113 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:53.730426 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.731471 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.732803 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.733413 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.733564 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:53.738238 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:53.738255 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:53.738273 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:53.738315 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:53.741407 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.742108 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.742116 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.742118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.742248 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.742609 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.742612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.742614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.742979 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:53.743240 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:53.743474 (+ 234us) server_negotiation.cc:299] Negotiation successful
0805 22:53:53.743677 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":394,"threads_started":1}
W20260805 22:53:53.745483 25439 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:35862
W20260805 22:53:53.746699 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 25257: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:53.746959 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 25257
I20260805 22:53:53.773494 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 25455
Aug 05 22:53:53 dist-test-slave-gmjp krb5kdc[25102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970433, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:53:53.791108 25849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:53.774662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57814 (local address 127.20.34.66:40731)
0805 22:53:53.775269 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:53.775277 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:53.775304 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:53:53.775367 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:53.775373 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:53.775604 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:53.775734 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:53.777185 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.778227 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.779508 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.780078 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.780309 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:53.784659 (+ 4350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:53.784672 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:53.784688 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:53.784725 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:53.787786 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.788764 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.788773 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.788775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.788907 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.789318 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.789322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.789325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.789698 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:53.790069 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:53.790413 (+ 344us) server_negotiation.cc:299] Negotiation successful
0805 22:53:53.790696 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":305,"threads_started":1}
W20260805 22:53:53.792670 25628 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57814
W20260805 22:53:53.793836 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 25455: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:53.794008 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 25455
I20260805 22:53:53.820007 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 25645
Aug 05 22:53:53 dist-test-slave-gmjp krb5kdc[25102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970433, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:53:53.838251 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:53.821191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32816 (local address 127.20.34.67:36887)
0805 22:53:53.821930 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:53.821941 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:53.821971 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:53:53.822033 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:53.822039 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:53.822268 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:53.822470 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:53.823884 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.825118 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.826395 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:53.826972 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:53.827121 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:53.831864 (+ 4743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:53.831879 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:53.831897 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:53.831939 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:53.835224 (+ 3285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.835959 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.835966 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.835969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.836104 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:53.836591 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:53.836594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:53.836596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:53.837016 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:53.837274 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:53.837583 (+ 309us) server_negotiation.cc:299] Negotiation successful
0805 22:53:53.837837 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":419,"threads_started":1}
W20260805 22:53:53.839742 25818 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:32816
W20260805 22:53:53.840981 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 25645: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:53:53.841143 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 25645
I20260805 22:53:53.867492 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 25119
I20260805 22:53:53.868824 25213 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:53.979722 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 25119
2026-08-05T22:53:54Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4238 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:54 dist-test-slave-gmjp krb5kdc[25857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:54 dist-test-slave-gmjp krb5kdc[25857](info): set up 2 sockets
Aug 05 22:53:54 dist-test-slave-gmjp krb5kdc[25857](info): commencing operation
krb5kdc: starting...
W20260805 22:53:55.289340 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:53:55 dist-test-slave-gmjp krb5kdc[25857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:53:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:53:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:53:55.564138 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:38917
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:38917
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:55.949743 25873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:55.950079 25873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:55.950274 25873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:55.957938 25873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:53:55.958081 25873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:55.958171 25873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:55.958279 25873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:53:55.958359 25873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:53:55.968883 25873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:38917
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:38917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:55.970438 25873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:55.971997 25873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:55.984771 25883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:55.984910 25887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:55.984745 25885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:55.986027 25873 server_base.cc:1034] running on GCE node
I20260805 22:53:55.987061 25873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:55.988819 25873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:55.990120 25873 hybrid_clock.cc:648] HybridClock initialized: now 1785970435990077 us; error 49 us; skew 500 ppm
I20260805 22:53:55.990602 25873 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:55 dist-test-slave-gmjp krb5kdc[25857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970435, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:55.994179 25873 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:53:55.995889 25873 webserver.cc:460] Webserver started at http://127.20.34.126:37183/ using document root <none> and password file <none>
I20260805 22:53:55.996749 25873 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:55.996912 25873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:55.997272 25873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:56.000689 25873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df"
format_stamp: "Formatted at 2026-08-05 22:53:55 on dist-test-slave-gmjp"
server_key: "86cf09bf6793cbde840b1a1fbcaff045"
server_key_iv: "e050cef4a306a14c174fcbf83b36a60a"
server_key_version: "encryptionkey@0"
I20260805 22:53:56.001588 25873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df"
format_stamp: "Formatted at 2026-08-05 22:53:55 on dist-test-slave-gmjp"
server_key: "86cf09bf6793cbde840b1a1fbcaff045"
server_key_iv: "e050cef4a306a14c174fcbf83b36a60a"
server_key_version: "encryptionkey@0"
I20260805 22:53:56.007309 25873 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:53:56.011112 25895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:56.012792 25873 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:53:56.013051 25873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df"
format_stamp: "Formatted at 2026-08-05 22:53:55 on dist-test-slave-gmjp"
server_key: "86cf09bf6793cbde840b1a1fbcaff045"
server_key_iv: "e050cef4a306a14c174fcbf83b36a60a"
server_key_version: "encryptionkey@0"
I20260805 22:53:56.013321 25873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:56.064805 25873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:56.069139 25873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:56.069470 25873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:56.089985 25873 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:38917
I20260805 22:53:56.090039 25977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:38917 every 8 connection(s)
I20260805 22:53:56.091522 25873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:53:56.092677 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 25873
I20260805 22:53:56.092952 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:53:56.093961 20617 external_mini_cluster.cc:1428] Setting key ace523954db9e1f4ae2130359685da6f
I20260805 22:53:56.096966 25978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 22:53:56 dist-test-slave-gmjp krb5kdc[25857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:56.111442 25978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df: Bootstrap starting.
I20260805 22:53:56.115239 25978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df: Neither blocks nor log segments found. Creating new log.
I20260805 22:53:56.116451 25978 log.cc:824] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df: Log is configured to *not* fsync() on all Append() calls
I20260805 22:53:56.119982 25983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:56.096127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50302 (local address 127.20.34.126:38917)
0805 22:53:56.097073 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:56.097092 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:56.097146 (+ 54us) server_negotiation.cc:407] Connection header received
0805 22:53:56.098919 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:56.098943 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:56.099365 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:56.099727 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:56.101882 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:56.103367 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:56.105289 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:56.106074 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:56.106223 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:56.111372 (+ 5149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:56.111382 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:56.111400 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:56.111459 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:56.114965 (+ 3506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:56.115895 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:56.115903 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:56.115911 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:56.116107 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:56.116622 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:56.116629 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:56.116637 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:56.117448 (+ 811us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:56.117788 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:56.118313 (+ 525us) server_negotiation.cc:299] Negotiation successful
0805 22:53:56.118914 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":386,"threads_started":1}
I20260805 22:53:56.120214 25978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df: No bootstrap required, opened a new log
I20260805 22:53:56.129171 25978 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38917 } }
I20260805 22:53:56.129648 25978 raft_consensus.cc:374] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:53:56.129774 25978 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd0b25c34dd4031ba3a7f1d4f3ee2df, State: Initialized, Role: FOLLOWER
I20260805 22:53:56.130471 25978 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38917 } }
I20260805 22:53:56.130733 25978 raft_consensus.cc:388] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:53:56.130889 25978 raft_consensus.cc:482] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:53:56.131074 25978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:53:56.133718 25978 raft_consensus.cc:504] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38917 } }
I20260805 22:53:56.134279 25978 leader_election.cc:302] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ffd0b25c34dd4031ba3a7f1d4f3ee2df; no voters:
I20260805 22:53:56.134894 25978 leader_election.cc:288] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:53:56.135070 25986 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:53:56.135823 25986 raft_consensus.cc:686] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [term 1 LEADER]: Becoming Leader. State: Replica: ffd0b25c34dd4031ba3a7f1d4f3ee2df, State: Running, Role: LEADER
I20260805 22:53:56.136422 25986 consensus_queue.cc:237] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38917 } }
I20260805 22:53:56.137199 25978 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:53:56.139808 25987 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38917 } } }
I20260805 22:53:56.140328 25987 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:56.140410 25989 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [sys.catalog]: SysCatalogTable state changed. Reason: New leader ffd0b25c34dd4031ba3a7f1d4f3ee2df. Latest consensus state: current_term: 1 leader_uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ffd0b25c34dd4031ba3a7f1d4f3ee2df" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38917 } } }
I20260805 22:53:56.140759 25989 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df [sys.catalog]: This master's current role is: LEADER
I20260805 22:53:56.148744 25996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:53:56.154201 25996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:53:56.163530 25996 catalog_manager.cc:1347] Generated new cluster ID: 9d960e3cbf794a00a892c2e986ccd853
I20260805 22:53:56.163697 25996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:53:56.183984 25996 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:53:56.186034 25996 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:53:56.198110 25996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ffd0b25c34dd4031ba3a7f1d4f3ee2df: Generated new TSK 0
I20260805 22:53:56.199311 25996 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:53:56.275740 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38917
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:56.640836 26013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:56.641163 26013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:56.641283 26013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:56.649205 26013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:56.649353 26013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:56.649535 26013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:53:56.660079 26013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:56.661551 26013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:56.662875 26013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:56.677253 26020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:56.677309 26024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:56.677201 26019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:56.678535 26013 server_base.cc:1034] running on GCE node
I20260805 22:53:56.679306 26013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:56.680420 26013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:56.681656 26013 hybrid_clock.cc:648] HybridClock initialized: now 1785970436681597 us; error 41 us; skew 500 ppm
I20260805 22:53:56.682010 26013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:56 dist-test-slave-gmjp krb5kdc[25857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970436, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:56.685493 26013 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:53:56.687202 26013 webserver.cc:460] Webserver started at http://127.20.34.65:37519/ using document root <none> and password file <none>
I20260805 22:53:56.687989 26013 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:56.688144 26013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:56.688532 26013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:56.691716 26013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "e7f5b669a00b4a6580b0bd92f44512e8"
format_stamp: "Formatted at 2026-08-05 22:53:56 on dist-test-slave-gmjp"
server_key: "2245726d2010604391afe50a3e0fa0aa"
server_key_iv: "a83208f87ea9018f4d7bb5beef478090"
server_key_version: "encryptionkey@0"
I20260805 22:53:56.692668 26013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "e7f5b669a00b4a6580b0bd92f44512e8"
format_stamp: "Formatted at 2026-08-05 22:53:56 on dist-test-slave-gmjp"
server_key: "2245726d2010604391afe50a3e0fa0aa"
server_key_iv: "a83208f87ea9018f4d7bb5beef478090"
server_key_version: "encryptionkey@0"
I20260805 22:53:56.698750 26013 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 22:53:56.702615 26036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:56.704115 26013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:53:56.704370 26013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "e7f5b669a00b4a6580b0bd92f44512e8"
format_stamp: "Formatted at 2026-08-05 22:53:56 on dist-test-slave-gmjp"
server_key: "2245726d2010604391afe50a3e0fa0aa"
server_key_iv: "a83208f87ea9018f4d7bb5beef478090"
server_key_version: "encryptionkey@0"
I20260805 22:53:56.704587 26013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:56.740118 26013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:56.744854 26013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:56.745179 26013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:56.746263 26013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:56.747772 26013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:56.747860 26013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:56.748052 26013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:56.748107 26013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:56.785298 26013 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:36239
I20260805 22:53:56.785401 26191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:36239 every 8 connection(s)
I20260805 22:53:56.786710 26013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:53:56.794409 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 26013
I20260805 22:53:56.794662 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:53:56.795498 20617 external_mini_cluster.cc:1428] Setting key 086f58470a3a4a69bb85cf2014258a80
Aug 05 22:53:56 dist-test-slave-gmjp krb5kdc[25857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970436, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:56.812009 26194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:56.789579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:57859 (local address 127.20.34.126:38917)
0805 22:53:56.790099 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:56.790104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:56.791273 (+ 1169us) server_negotiation.cc:407] Connection header received
0805 22:53:56.793307 (+ 2034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:56.793313 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:56.793413 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:56.793540 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:56.795873 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:56.796871 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:56.799279 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:56.799699 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:56.799801 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:56.804885 (+ 5084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:56.804891 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:56.804895 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:56.804933 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:56.807895 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:56.808955 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:56.808964 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:56.808970 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:56.809150 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:56.809824 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:56.809833 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:56.809840 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:56.810252 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:56.810426 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:56.811222 (+ 796us) server_negotiation.cc:299] Negotiation successful
0805 22:53:56.811516 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":258,"threads_started":1}
I20260805 22:53:56.812724 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:56.790266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:38917 (local address 127.20.34.65:57859)
0805 22:53:56.791073 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:56.791113 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:56.793011 (+ 1898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:56.793922 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:56.793937 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:56.794757 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:56.795650 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:56.795680 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:56.797062 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:56.797066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:56.799107 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:56.799127 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:56.799963 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:56.799974 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:56.800368 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:56.801224 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:56.801273 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:56.804558 (+ 3285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:56.808081 (+ 3523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:56.808090 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:56.808107 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:56.808805 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:56.809317 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:56.809321 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:56.809323 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:56.809677 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:56.810386 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:56.810392 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:56.810760 (+ 368us) client_negotiation.cc:769] Sending connection context
0805 22:53:56.811047 (+ 287us) client_negotiation.cc:240] Negotiation successful
0805 22:53:56.811483 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":313,"threads_started":1}
I20260805 22:53:56.814536 26192 heartbeater.cc:347] Connected to a master server at 127.20.34.126:38917
I20260805 22:53:56.814874 26192 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:56.815644 26192 heartbeater.cc:511] Master 127.20.34.126:38917 requested a full tablet report, sending...
I20260805 22:53:56.818084 25919 ts_manager.cc:194] Registered new tserver with Master: e7f5b669a00b4a6580b0bd92f44512e8 (127.20.34.65:36239)
I20260805 22:53:56.819749 25919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:57859
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:53:56.856217 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38917
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:57.234222 26200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:57.234593 26200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:57.234776 26200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:57.242780 26200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:57.242962 26200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:57.243152 26200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:53:57.253698 26200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:57.255214 26200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:57.256747 26200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:57.270948 26210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:57.270884 26206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:57.270992 26207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:57.271944 26200 server_base.cc:1034] running on GCE node
I20260805 22:53:57.272714 26200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:57.273727 26200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:57.274999 26200 hybrid_clock.cc:648] HybridClock initialized: now 1785970437274926 us; error 56 us; skew 500 ppm
I20260805 22:53:57.275345 26200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:57 dist-test-slave-gmjp krb5kdc[25857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:57.278661 26200 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:53:57.280223 26200 webserver.cc:460] Webserver started at http://127.20.34.66:40373/ using document root <none> and password file <none>
I20260805 22:53:57.280962 26200 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:57.281116 26200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:57.281451 26200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:57.284590 26200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "0cb0f1c15192404f8cb0fb089e115f7e"
format_stamp: "Formatted at 2026-08-05 22:53:57 on dist-test-slave-gmjp"
server_key: "b5a6ab3aa06d6f2b66c3396803b3bfd2"
server_key_iv: "42246af24b322e6879aeae0f63e88c63"
server_key_version: "encryptionkey@0"
I20260805 22:53:57.285434 26200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "0cb0f1c15192404f8cb0fb089e115f7e"
format_stamp: "Formatted at 2026-08-05 22:53:57 on dist-test-slave-gmjp"
server_key: "b5a6ab3aa06d6f2b66c3396803b3bfd2"
server_key_iv: "42246af24b322e6879aeae0f63e88c63"
server_key_version: "encryptionkey@0"
I20260805 22:53:57.291247 26200 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260805 22:53:57.295128 26223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:57.296640 26200 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:53:57.296870 26200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "0cb0f1c15192404f8cb0fb089e115f7e"
format_stamp: "Formatted at 2026-08-05 22:53:57 on dist-test-slave-gmjp"
server_key: "b5a6ab3aa06d6f2b66c3396803b3bfd2"
server_key_iv: "42246af24b322e6879aeae0f63e88c63"
server_key_version: "encryptionkey@0"
I20260805 22:53:57.297107 26200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:57.316538 26200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:57.321241 26200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:57.321578 26200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:57.322616 26200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:57.324117 26200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:57.324245 26200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 22:53:57.324394 26200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:57.324481 26200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:57.362869 26200 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:36283
I20260805 22:53:57.362959 26389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:36283 every 8 connection(s)
I20260805 22:53:57.364295 26200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:53:57.364646 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 26200
I20260805 22:53:57.364871 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:53:57.365448 20617 external_mini_cluster.cc:1428] Setting key 9f8c81108a4745014ce91342299995f8
Aug 05 22:53:57 dist-test-slave-gmjp krb5kdc[25857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:57.390499 26393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:57.367246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:34293 (local address 127.20.34.126:38917)
0805 22:53:57.367778 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:57.367784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:57.368942 (+ 1158us) server_negotiation.cc:407] Connection header received
0805 22:53:57.371961 (+ 3019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:57.371966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:57.372038 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:57.372136 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:57.374683 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.375467 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.378113 (+ 2646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.378602 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.378790 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:57.382714 (+ 3924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:57.382723 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:57.382731 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:57.382780 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:57.386656 (+ 3876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:57.387509 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:57.387518 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:57.387524 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:57.387691 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:57.388269 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:57.388277 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:57.388283 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:57.388717 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:57.388896 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:57.389713 (+ 817us) server_negotiation.cc:299] Negotiation successful
0805 22:53:57.390008 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":269,"threads_started":1}
I20260805 22:53:57.391271 26394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:57.367904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:38917 (local address 127.20.34.66:34293)
0805 22:53:57.368750 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:57.368802 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:57.371603 (+ 2801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:57.372499 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:57.372515 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:57.373464 (+ 949us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:57.374427 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:57.374461 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.375667 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.375675 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:57.377928 (+ 2253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:57.377948 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.378890 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.378896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:57.379107 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:57.379869 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:57.379899 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:57.382426 (+ 2527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:57.386818 (+ 4392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:57.386827 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:57.386844 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:57.387352 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:57.387855 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:57.387859 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:57.387861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:57.388094 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:57.388879 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:57.388886 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:57.389249 (+ 363us) client_negotiation.cc:769] Sending connection context
0805 22:53:57.389559 (+ 310us) client_negotiation.cc:240] Negotiation successful
0805 22:53:57.390070 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":317,"threads_started":1}
I20260805 22:53:57.393026 26391 heartbeater.cc:347] Connected to a master server at 127.20.34.126:38917
I20260805 22:53:57.393369 26391 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
I20260805 22:53:57.394217 26391 heartbeater.cc:511] Master 127.20.34.126:38917 requested a full tablet report, sending...
I20260805 22:53:57.395851 25919 ts_manager.cc:194] Registered new tserver with Master: 0cb0f1c15192404f8cb0fb089e115f7e (127.20.34.66:36283)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
I20260805 22:53:57.396829 25919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:34293
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:53:57.427498 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38917
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:53:57.782541 26398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:53:57.782938 26398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:53:57.783142 26398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:53:57.791452 26398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:53:57.791625 26398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:53:57.791828 26398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:53:57.802649 26398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38917
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:53:57.804347 26398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:53:57.805806 26398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:53:57.820493 26408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:57.820658 26413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:53:57.820604 26405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:53:57.821816 26398 server_base.cc:1034] running on GCE node
I20260805 22:53:57.822527 26398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:53:57.822938 26192 heartbeater.cc:503] Master 127.20.34.126:38917 was elected leader, sending a full tablet report...
I20260805 22:53:57.823707 26398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:53:57.825003 26398 hybrid_clock.cc:648] HybridClock initialized: now 1785970437824953 us; error 48 us; skew 500 ppm
I20260805 22:53:57.825357 26398 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:53:57 dist-test-slave-gmjp krb5kdc[25857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:53:57.828614 26398 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:53:57.830127 26398 webserver.cc:460] Webserver started at http://127.20.34.67:35441/ using document root <none> and password file <none>
I20260805 22:53:57.830945 26398 fs_manager.cc:359] Metadata directory not provided
I20260805 22:53:57.831099 26398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:53:57.831445 26398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:53:57.834631 26398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "0f88448be1ab407db92dfff117dc952f"
format_stamp: "Formatted at 2026-08-05 22:53:57 on dist-test-slave-gmjp"
server_key: "a13f6e1581814aad2a7919810b0675d2"
server_key_iv: "982045521cb524dee698e3232c75d31a"
server_key_version: "encryptionkey@0"
I20260805 22:53:57.835510 26398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "0f88448be1ab407db92dfff117dc952f"
format_stamp: "Formatted at 2026-08-05 22:53:57 on dist-test-slave-gmjp"
server_key: "a13f6e1581814aad2a7919810b0675d2"
server_key_iv: "982045521cb524dee698e3232c75d31a"
server_key_version: "encryptionkey@0"
I20260805 22:53:57.841403 26398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:53:57.845232 26423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:57.846693 26398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:53:57.846906 26398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "0f88448be1ab407db92dfff117dc952f"
format_stamp: "Formatted at 2026-08-05 22:53:57 on dist-test-slave-gmjp"
server_key: "a13f6e1581814aad2a7919810b0675d2"
server_key_iv: "982045521cb524dee698e3232c75d31a"
server_key_version: "encryptionkey@0"
I20260805 22:53:57.847142 26398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:53:57.865468 26398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:53:57.870278 26398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:53:57.870604 26398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:53:57.871683 26398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:53:57.873240 26398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:53:57.873349 26398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:57.873507 26398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:53:57.873584 26398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:53:57.909529 26398 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:36945
I20260805 22:53:57.909616 26603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:36945 every 8 connection(s)
I20260805 22:53:57.910900 26398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:53:57.915920 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 26398
I20260805 22:53:57.916126 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:53:57.916738 20617 external_mini_cluster.cc:1428] Setting key 8b15443fabab6087005333ab212c5ff8
Aug 05 22:53:57 dist-test-slave-gmjp krb5kdc[25857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:57.933559 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:57.913788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:48551 (local address 127.20.34.126:38917)
0805 22:53:57.914285 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:57.914290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:57.915331 (+ 1041us) server_negotiation.cc:407] Connection header received
0805 22:53:57.918089 (+ 2758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:57.918095 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:57.918215 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:57.918324 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:57.920566 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.921462 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.923062 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.923458 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.923554 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:57.927237 (+ 3683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:57.927242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:57.927246 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:57.927281 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:57.929872 (+ 2591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:57.930667 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:57.930673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:57.930675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:57.930832 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:57.931413 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:57.931418 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:57.931421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:57.931806 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:57.931987 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:57.932906 (+ 919us) server_negotiation.cc:299] Negotiation successful
0805 22:53:57.933144 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":244,"threads_started":1}
I20260805 22:53:57.934643 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:57.914389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:38917 (local address 127.20.34.67:48551)
0805 22:53:57.915152 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0805 22:53:57.915192 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:53:57.917774 (+ 2582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:53:57.918647 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:53:57.918656 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:53:57.919437 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:53:57.920360 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:57.920394 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.921618 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.921623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:57.922931 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:53:57.922944 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.923664 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.923669 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:53:57.923899 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:57.924650 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:53:57.924681 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:53:57.926985 (+ 2304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:53:57.930013 (+ 3028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:57.930021 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:57.930036 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:57.930485 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:57.930998 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:53:57.931002 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:53:57.931007 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:53:57.931290 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:53:57.931952 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:53:57.931963 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:53:57.932452 (+ 489us) client_negotiation.cc:769] Sending connection context
0805 22:53:57.932769 (+ 317us) client_negotiation.cc:240] Negotiation successful
0805 22:53:57.933357 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":365,"threads_started":1}
I20260805 22:53:57.936319 26604 heartbeater.cc:347] Connected to a master server at 127.20.34.126:38917
I20260805 22:53:57.936659 26604 heartbeater.cc:464] Registering TS with master...
I20260805 22:53:57.937613 26604 heartbeater.cc:511] Master 127.20.34.126:38917 requested a full tablet report, sending...
I20260805 22:53:57.939317 25919 ts_manager.cc:194] Registered new tserver with Master: 0f88448be1ab407db92dfff117dc952f (127.20.34.67:36945)
I20260805 22:53:57.940276 25919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:48551
I20260805 22:53:57.945755 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:53:57 dist-test-slave-gmjp krb5kdc[25857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:53:57 dist-test-slave-gmjp krb5kdc[25857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:53:58.010492 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:57.993751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45000 (local address 127.20.34.65:36239)
0805 22:53:57.994439 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:57.994447 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:57.994495 (+ 48us) server_negotiation.cc:407] Connection header received
0805 22:53:57.994561 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:57.994568 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:57.994800 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:57.994941 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:57.996510 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.997550 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.998791 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:57.999386 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:57.999488 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:58.004208 (+ 4720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:58.004234 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:58.004252 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:58.004310 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:58.007218 (+ 2908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.008062 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.008070 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.008072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.008282 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.008717 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.008722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.008726 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.009131 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:58.009475 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:58.009792 (+ 317us) server_negotiation.cc:299] Negotiation successful
0805 22:53:58.010095 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":317,"threads_started":1}
Aug 05 22:53:58 dist-test-slave-gmjp krb5kdc[25857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:53:58.030673 26608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:58.015741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50314 (local address 127.20.34.126:38917)
0805 22:53:58.015966 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:58.015973 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:58.016100 (+ 127us) server_negotiation.cc:407] Connection header received
0805 22:53:58.016364 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:58.016369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:58.016472 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:58.016587 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:58.018021 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:58.018855 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:58.020168 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:58.020618 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:58.020768 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:58.024951 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:58.024957 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:58.024960 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:58.025003 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:58.027641 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.028484 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.028492 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.028500 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.028649 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.029071 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.029075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.029077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.029444 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:58.029712 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:58.030093 (+ 381us) server_negotiation.cc:299] Negotiation successful
0805 22:53:58.030351 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260805 22:53:58.031414 25919 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50314
I20260805 22:53:58.032721 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 26013
I20260805 22:53:58.046437 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:58.033676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45008 (local address 127.20.34.65:36239)
0805 22:53:58.033889 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:58.033894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:58.034203 (+ 309us) server_negotiation.cc:407] Connection header received
0805 22:53:58.034332 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:58.034335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:58.034447 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:58.034542 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:58.035810 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:58.036646 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:58.037934 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:58.038356 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:58.038473 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:58.041041 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:58.041046 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:58.041050 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:58.041086 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:58.043885 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.044632 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.044637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.044639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.044785 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.045160 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.045163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.045165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.045460 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:58.045645 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:58.045996 (+ 351us) server_negotiation.cc:299] Negotiation successful
0805 22:53:58.046190 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 22:53:58.047130 26186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:58.133651 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 26013
I20260805 22:53:58.163292 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 26200
Aug 05 22:53:58 dist-test-slave-gmjp krb5kdc[25857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:53:58.180809 26628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:58.164303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50712 (local address 127.20.34.66:36283)
0805 22:53:58.164889 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:58.164898 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:58.164923 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:53:58.164996 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:58.165002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:58.165222 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:58.165427 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:58.166673 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:58.167717 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:58.169211 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:58.169841 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:58.170002 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:58.174519 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:58.174535 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:58.174552 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:58.174602 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:58.177641 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.178403 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.178411 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.178413 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.178571 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.179008 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.179012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.179014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.179395 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:58.179724 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:58.180078 (+ 354us) server_negotiation.cc:299] Negotiation successful
0805 22:53:58.180430 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":282,"threads_started":1}
I20260805 22:53:58.182296 26384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:58.268287 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 26200
I20260805 22:53:58.295491 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 26398
Aug 05 22:53:58 dist-test-slave-gmjp krb5kdc[25857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:53:58.312942 26631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:53:58.296822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47276 (local address 127.20.34.67:36945)
0805 22:53:58.297519 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0805 22:53:58.297526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:53:58.297558 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:53:58.297658 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:53:58.297665 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:53:58.297892 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:53:58.298041 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:53:58.299429 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:58.300640 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:58.302055 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:53:58.302622 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:53:58.302729 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:53:58.307096 (+ 4367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:53:58.307109 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:53:58.307126 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:53:58.307163 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:53:58.310117 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.310869 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.310876 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.310878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.311013 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:53:58.311396 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:53:58.311399 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:53:58.311401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:53:58.311749 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:53:58.311996 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0805 22:53:58.312404 (+ 408us) server_negotiation.cc:299] Negotiation successful
0805 22:53:58.312630 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":378,"threads_started":1}
I20260805 22:53:58.314355 26596 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:58.402586 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 26398
I20260805 22:53:58.428124 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 25873
I20260805 22:53:58.429579 25973 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:53:58.537802 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 25873
2026-08-05T22:53:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4562 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:53:58 dist-test-slave-gmjp krb5kdc[26637](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:53:58 dist-test-slave-gmjp krb5kdc[26637](info): set up 2 sockets
Aug 05 22:53:58 dist-test-slave-gmjp krb5kdc[26637](info): commencing operation
krb5kdc: starting...
W20260805 22:53:59.869665 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:54:00 dist-test-slave-gmjp krb5kdc[26637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:54:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:54:00.147313 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:41711
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:41711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:00.502430 26654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:00.502856 26654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:00.503036 26654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:00.511432 26654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:00.511607 26654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:00.511695 26654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:00.511794 26654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:00.511869 26654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:00.522357 26654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:41711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:41711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:00.523864 26654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:00.525388 26654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:00.537912 26667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:00.538002 26664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:00.537949 26663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:00.539343 26654 server_base.cc:1034] running on GCE node
I20260805 22:54:00.540426 26654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:00.542078 26654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:00.543334 26654 hybrid_clock.cc:648] HybridClock initialized: now 1785970440543298 us; error 60 us; skew 500 ppm
I20260805 22:54:00.543716 26654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:00 dist-test-slave-gmjp krb5kdc[26637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970440, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:00.547144 26654 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:54:00.548563 26654 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:00.548705 26654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:00.549085 26654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:00.552381 26654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "7ee82735cdc04d348ac0f64f6bc9fa91"
format_stamp: "Formatted at 2026-08-05 22:54:00 on dist-test-slave-gmjp"
server_key: "458272552c49278795dab1cf05cc351a"
server_key_iv: "21769780a07eebb333549031ac4149f7"
server_key_version: "encryptionkey@0"
I20260805 22:54:00.553263 26654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "7ee82735cdc04d348ac0f64f6bc9fa91"
format_stamp: "Formatted at 2026-08-05 22:54:00 on dist-test-slave-gmjp"
server_key: "458272552c49278795dab1cf05cc351a"
server_key_iv: "21769780a07eebb333549031ac4149f7"
server_key_version: "encryptionkey@0"
I20260805 22:54:00.559180 26654 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 22:54:00.563232 26674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:00.564898 26654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:00.565110 26654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "7ee82735cdc04d348ac0f64f6bc9fa91"
format_stamp: "Formatted at 2026-08-05 22:54:00 on dist-test-slave-gmjp"
server_key: "458272552c49278795dab1cf05cc351a"
server_key_iv: "21769780a07eebb333549031ac4149f7"
server_key_version: "encryptionkey@0"
I20260805 22:54:00.565371 26654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:00.587567 26654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:00.592722 26654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:00.593075 26654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:00.614498 26654 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:41711
I20260805 22:54:00.614519 26750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:41711 every 8 connection(s)
I20260805 22:54:00.615563 26654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:00.620070 26751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:00.625465 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 26654
I20260805 22:54:00.625744 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:00.626431 20617 external_mini_cluster.cc:1428] Setting key 6fa8587f06630dadbff09be52fe61f30
I20260805 22:54:00.634606 26751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91: Bootstrap starting.
I20260805 22:54:00.638823 26751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:00.640130 26751 log.cc:824] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:00.643972 26751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91: No bootstrap required, opened a new log
Aug 05 22:54:00 dist-test-slave-gmjp krb5kdc[26637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:00.652068 26751 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee82735cdc04d348ac0f64f6bc9fa91" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 41711 } }
I20260805 22:54:00.652580 26751 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:00.652740 26751 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee82735cdc04d348ac0f64f6bc9fa91, State: Initialized, Role: FOLLOWER
I20260805 22:54:00.653363 26751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee82735cdc04d348ac0f64f6bc9fa91" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 41711 } }
I20260805 22:54:00.653640 26751 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:00.653798 26751 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:00.654001 26751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:00.654346 26754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:00.628912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33284 (local address 127.20.34.126:41711)
0805 22:54:00.629946 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:00.629967 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:00.630047 (+ 80us) server_negotiation.cc:407] Connection header received
0805 22:54:00.633017 (+ 2970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:00.633054 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:00.633629 (+ 575us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:00.634120 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:00.635723 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:00.637989 (+ 2266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:00.639553 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:00.640677 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:00.640918 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:00.645934 (+ 5016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:00.645943 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:00.645960 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:00.646001 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:00.649362 (+ 3361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:00.650141 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:00.650150 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:00.650160 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:00.650374 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:00.650792 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:00.650799 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:00.650802 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:00.651413 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:00.651722 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:00.652283 (+ 561us) server_negotiation.cc:299] Negotiation successful
0805 22:54:00.652985 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":433,"threads_started":1}
I20260805 22:54:00.656672 26751 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee82735cdc04d348ac0f64f6bc9fa91" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 41711 } }
I20260805 22:54:00.657219 26751 leader_election.cc:302] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ee82735cdc04d348ac0f64f6bc9fa91; no voters:
I20260805 22:54:00.657963 26751 leader_election.cc:288] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:00.658144 26758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:00.659425 26758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [term 1 LEADER]: Becoming Leader. State: Replica: 7ee82735cdc04d348ac0f64f6bc9fa91, State: Running, Role: LEADER
I20260805 22:54:00.660096 26758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee82735cdc04d348ac0f64f6bc9fa91" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 41711 } }
I20260805 22:54:00.660405 26751 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:00.664589 26759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ee82735cdc04d348ac0f64f6bc9fa91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee82735cdc04d348ac0f64f6bc9fa91" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 41711 } } }
I20260805 22:54:00.664985 26759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:00.664887 26760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ee82735cdc04d348ac0f64f6bc9fa91. Latest consensus state: current_term: 1 leader_uuid: "7ee82735cdc04d348ac0f64f6bc9fa91" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ee82735cdc04d348ac0f64f6bc9fa91" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 41711 } } }
I20260805 22:54:00.665198 26760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:00.669620 26773 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:00.677210 26773 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:00.687939 26773 catalog_manager.cc:1347] Generated new cluster ID: 579972f9e7434d81877c4b267a1db86c
I20260805 22:54:00.688094 26773 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:00.702971 26773 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:00.705032 26773 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:00.719942 26773 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91: Generated new TSK 0
I20260805 22:54:00.721253 26773 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:54:00.792353 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:41711
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:01.157287 26791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:01.157651 26791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:01.157829 26791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:01.166185 26791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:01.166383 26791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:01.166567 26791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:54:01.177481 26791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:41711
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:01.179020 26791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:01.180593 26791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:01.205142 26803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:01.205348 26801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:01.206022 26805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:01.206288 26791 server_base.cc:1034] running on GCE node
I20260805 22:54:01.207238 26791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:01.209466 26791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:01.210784 26791 hybrid_clock.cc:648] HybridClock initialized: now 1785970441210716 us; error 51 us; skew 500 ppm
I20260805 22:54:01.211340 26791 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:01 dist-test-slave-gmjp krb5kdc[26637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970441, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:01.216334 26791 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:54:01.217736 26791 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:01.217876 26791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:01.218364 26791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:01.222393 26791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "7aff144c91e24443b79c727726f9952f"
format_stamp: "Formatted at 2026-08-05 22:54:01 on dist-test-slave-gmjp"
server_key: "ae141bc56ba2888ee217c37210db50bc"
server_key_iv: "d7417e9d114365bc681b9c38926794fb"
server_key_version: "encryptionkey@0"
I20260805 22:54:01.223434 26791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "7aff144c91e24443b79c727726f9952f"
format_stamp: "Formatted at 2026-08-05 22:54:01 on dist-test-slave-gmjp"
server_key: "ae141bc56ba2888ee217c37210db50bc"
server_key_iv: "d7417e9d114365bc681b9c38926794fb"
server_key_version: "encryptionkey@0"
I20260805 22:54:01.229714 26791 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 22:54:01.233599 26815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:01.234992 26791 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:01.235183 26791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "7aff144c91e24443b79c727726f9952f"
format_stamp: "Formatted at 2026-08-05 22:54:01 on dist-test-slave-gmjp"
server_key: "ae141bc56ba2888ee217c37210db50bc"
server_key_iv: "d7417e9d114365bc681b9c38926794fb"
server_key_version: "encryptionkey@0"
I20260805 22:54:01.235450 26791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:01.252085 26791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:01.256980 26791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:01.257302 26791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:01.258404 26791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:01.260015 26791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:01.260147 26791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:01.260353 26791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:01.260452 26791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:01.298413 26791 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:37637
I20260805 22:54:01.298478 26985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:37637 every 8 connection(s)
I20260805 22:54:01.299446 26791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:54:01.303365 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 26791
I20260805 22:54:01.303630 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:54:01.304436 20617 external_mini_cluster.cc:1428] Setting key 843e31ef4188a2a4c83de9583af17a96
Aug 05 22:54:01 dist-test-slave-gmjp krb5kdc[26637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970441, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:01.323081 26992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:01.302539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:55549 (local address 127.20.34.126:41711)
0805 22:54:01.303231 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:01.303241 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:01.305060 (+ 1819us) server_negotiation.cc:407] Connection header received
0805 22:54:01.307427 (+ 2367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:01.307432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:01.307537 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:01.307679 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:01.309556 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:01.310329 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:01.312007 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:01.312491 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:01.312641 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:01.316434 (+ 3793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:01.316439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:01.316443 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:01.316477 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:01.319654 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:01.320567 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:01.320579 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:01.320582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:01.320708 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:01.321178 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:01.321182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:01.321184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:01.321467 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:01.321649 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:01.322430 (+ 781us) server_negotiation.cc:299] Negotiation successful
0805 22:54:01.322685 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":332,"threads_started":1}
I20260805 22:54:01.324131 26995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:01.303201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:41711 (local address 127.20.34.65:55549)
0805 22:54:01.304824 (+ 1623us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:01.304892 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:01.307098 (+ 2206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:01.307960 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:01.307970 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:01.308637 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:01.309278 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:01.309302 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:01.310505 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:01.310511 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:01.311832 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:01.311845 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:01.312750 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:01.312757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:01.313014 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:01.313809 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:01.313833 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:01.316120 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:01.319824 (+ 3704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:01.319835 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:01.319855 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:01.320429 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:01.320835 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:01.320840 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:01.320844 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:01.321045 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:01.321608 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:01.321616 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:01.322011 (+ 395us) client_negotiation.cc:769] Sending connection context
0805 22:54:01.322305 (+ 294us) client_negotiation.cc:240] Negotiation successful
0805 22:54:01.322936 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1294,"thread_start_us":1070,"threads_started":1}
I20260805 22:54:01.325958 26987 heartbeater.cc:347] Connected to a master server at 127.20.34.126:41711
I20260805 22:54:01.326359 26987 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:01.327243 26987 heartbeater.cc:511] Master 127.20.34.126:41711 requested a full tablet report, sending...
I20260805 22:54:01.329734 26697 ts_manager.cc:194] Registered new tserver with Master: 7aff144c91e24443b79c727726f9952f (127.20.34.65:37637)
I20260805 22:54:01.331272 26697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:55549
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:54:01.367817 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:41711
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:01.729895 26998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:01.730270 26998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:01.730455 26998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:01.738287 26998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:01.738485 26998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:01.738626 26998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:54:01.749117 26998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:41711
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:01.750504 26998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:01.751849 26998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:01.765900 27011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:01.765883 27005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:01.765969 27008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:01.767215 26998 server_base.cc:1034] running on GCE node
I20260805 22:54:01.767836 26998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:01.768978 26998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:01.770188 26998 hybrid_clock.cc:648] HybridClock initialized: now 1785970441770142 us; error 31 us; skew 500 ppm
I20260805 22:54:01.770505 26998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:01 dist-test-slave-gmjp krb5kdc[26637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970441, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:01.774039 26998 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:54:01.775408 26998 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:01.775532 26998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:01.775897 26998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:01.779146 26998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "2142bb65b795463fa19af7ed7ba66157"
format_stamp: "Formatted at 2026-08-05 22:54:01 on dist-test-slave-gmjp"
server_key: "023cc2d6effa320d3984550376736348"
server_key_iv: "847b75bb9ce14afaf1ac63a12d6efe58"
server_key_version: "encryptionkey@0"
I20260805 22:54:01.780037 26998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "2142bb65b795463fa19af7ed7ba66157"
format_stamp: "Formatted at 2026-08-05 22:54:01 on dist-test-slave-gmjp"
server_key: "023cc2d6effa320d3984550376736348"
server_key_iv: "847b75bb9ce14afaf1ac63a12d6efe58"
server_key_version: "encryptionkey@0"
I20260805 22:54:01.785475 26998 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:54:01.789343 27021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:01.790913 26998 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:01.791106 26998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "2142bb65b795463fa19af7ed7ba66157"
format_stamp: "Formatted at 2026-08-05 22:54:01 on dist-test-slave-gmjp"
server_key: "023cc2d6effa320d3984550376736348"
server_key_iv: "847b75bb9ce14afaf1ac63a12d6efe58"
server_key_version: "encryptionkey@0"
I20260805 22:54:01.791359 26998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:01.804569 26998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:01.809572 26998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:01.809909 26998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:01.811203 26998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:01.812845 26998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:01.812938 26998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:01.813076 26998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:01.813180 26998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:01.849452 26998 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:35867
I20260805 22:54:01.849550 27181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:35867 every 8 connection(s)
I20260805 22:54:01.850435 26998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:54:01.856925 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 26998
I20260805 22:54:01.857163 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:54:01.857678 20617 external_mini_cluster.cc:1428] Setting key 2816e8fcc5d0182713ae7f295c594962
Aug 05 22:54:01 dist-test-slave-gmjp krb5kdc[26637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970441, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:01.872856 27186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:01.853283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:39901 (local address 127.20.34.126:41711)
0805 22:54:01.853766 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:01.853772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:01.854963 (+ 1191us) server_negotiation.cc:407] Connection header received
0805 22:54:01.856983 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:01.856989 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:01.857104 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:01.857248 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:01.858974 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:01.859756 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:01.861471 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:01.861994 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:01.862143 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:01.866348 (+ 4205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:01.866354 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:01.866358 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:01.866396 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:01.869245 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:01.870215 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:01.870225 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:01.870227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:01.870368 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:01.870878 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:01.870882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:01.870884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:01.871184 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:01.871357 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:01.872200 (+ 843us) server_negotiation.cc:299] Negotiation successful
0805 22:54:01.872456 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":234,"threads_started":1}
I20260805 22:54:01.873960 27188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:01.853951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:41711 (local address 127.20.34.66:39901)
0805 22:54:01.854746 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:01.854817 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:01.856668 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:01.857493 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:01.857501 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:01.858153 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:01.858770 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:01.858798 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:01.859940 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:01.859944 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:01.861312 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:01.861325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:01.862247 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:01.862255 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:01.862565 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:01.863416 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:01.863483 (+ 67us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:01.866043 (+ 2560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:01.869436 (+ 3393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:01.869447 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:01.869476 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:01.870057 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:01.870496 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:01.870501 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:01.870505 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:01.870715 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:01.871336 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:01.871345 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:01.871766 (+ 421us) client_negotiation.cc:769] Sending connection context
0805 22:54:01.872061 (+ 295us) client_negotiation.cc:240] Negotiation successful
0805 22:54:01.872687 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":324,"threads_started":1}
I20260805 22:54:01.875622 27182 heartbeater.cc:347] Connected to a master server at 127.20.34.126:41711
I20260805 22:54:01.875984 27182 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:01.876744 27182 heartbeater.cc:511] Master 127.20.34.126:41711 requested a full tablet report, sending...
I20260805 22:54:01.878428 26697 ts_manager.cc:194] Registered new tserver with Master: 2142bb65b795463fa19af7ed7ba66157 (127.20.34.66:35867)
I20260805 22:54:01.879829 26697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:39901
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:54:01.919018 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:41711
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:02.277751 27192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:02.278081 27192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:02.278182 27192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:02.285771 27192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:02.285907 27192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:02.286038 27192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:54:02.296869 27192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:41711
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:02.298636 27192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:02.300467 27192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:02.315768 27197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:02.315848 27201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:02.315807 27199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:02.316636 27192 server_base.cc:1034] running on GCE node
I20260805 22:54:02.317368 27192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:02.318421 27192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:02.319679 27192 hybrid_clock.cc:648] HybridClock initialized: now 1785970442319620 us; error 51 us; skew 500 ppm
I20260805 22:54:02.320037 27192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:02 dist-test-slave-gmjp krb5kdc[26637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970442, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:02.323465 27192 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:54:02.324813 27192 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:02.324994 27192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:02.325363 27192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:02.328573 27192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "8cc80422f9d0478488861c277ac1035c"
format_stamp: "Formatted at 2026-08-05 22:54:02 on dist-test-slave-gmjp"
server_key: "56127b79e9caed66154f91d4245eb677"
server_key_iv: "1ba1987bc7fb812219c0b261e5daf48b"
server_key_version: "encryptionkey@0"
I20260805 22:54:02.329453 27192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "8cc80422f9d0478488861c277ac1035c"
format_stamp: "Formatted at 2026-08-05 22:54:02 on dist-test-slave-gmjp"
server_key: "56127b79e9caed66154f91d4245eb677"
server_key_iv: "1ba1987bc7fb812219c0b261e5daf48b"
server_key_version: "encryptionkey@0"
I20260805 22:54:02.334496 26987 heartbeater.cc:503] Master 127.20.34.126:41711 was elected leader, sending a full tablet report...
I20260805 22:54:02.335193 27192 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:54:02.339450 27210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:02.341152 27192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 22:54:02.341367 27192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "8cc80422f9d0478488861c277ac1035c"
format_stamp: "Formatted at 2026-08-05 22:54:02 on dist-test-slave-gmjp"
server_key: "56127b79e9caed66154f91d4245eb677"
server_key_iv: "1ba1987bc7fb812219c0b261e5daf48b"
server_key_version: "encryptionkey@0"
I20260805 22:54:02.341621 27192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:02.359751 27192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:02.364831 27192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:02.365126 27192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:02.366182 27192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:02.367655 27192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:02.367745 27192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:02.367910 27192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:02.367990 27192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:02.405088 27192 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:37745
I20260805 22:54:02.405140 27365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:37745 every 8 connection(s)
I20260805 22:54:02.406080 27192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:54:02.406999 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 27192
I20260805 22:54:02.407212 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:54:02.407689 20617 external_mini_cluster.cc:1428] Setting key 7c385153c3e0c74c3f65bbfe0e749c5d
Aug 05 22:54:02 dist-test-slave-gmjp krb5kdc[26637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970442, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:02.427686 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.408906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:49729 (local address 127.20.34.126:41711)
0805 22:54:02.409419 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.409425 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.410885 (+ 1460us) server_negotiation.cc:407] Connection header received
0805 22:54:02.413021 (+ 2136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.413025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.413113 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.413214 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:02.414808 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.415572 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.417246 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.417689 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.417794 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.421474 (+ 3680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:02.421480 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:02.421484 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:02.421522 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:02.424740 (+ 3218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:02.425539 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:02.425543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:02.425546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:02.425670 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:02.426086 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:02.426089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:02.426091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:02.426384 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:02.426498 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.427233 (+ 735us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.427416 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":239,"threads_started":1}
I20260805 22:54:02.428774 27373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.409727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:41711 (local address 127.20.34.67:49729)
0805 22:54:02.410670 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:02.410731 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:02.412687 (+ 1956us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:02.413432 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:02.413441 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:02.414031 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:02.414629 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.414652 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.415712 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.415716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.417100 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.417114 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.417915 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.417919 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.418110 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.418781 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:02.418805 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:02.421222 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:02.424903 (+ 3681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:02.424911 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:02.424927 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:02.425423 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:02.425763 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:02.425766 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:02.425768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:02.425982 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:02.426493 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:02.426499 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:02.426878 (+ 379us) client_negotiation.cc:769] Sending connection context
0805 22:54:02.427121 (+ 243us) client_negotiation.cc:240] Negotiation successful
0805 22:54:02.427549 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":372,"threads_started":1}
I20260805 22:54:02.430478 27366 heartbeater.cc:347] Connected to a master server at 127.20.34.126:41711
I20260805 22:54:02.430795 27366 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:02.431464 27366 heartbeater.cc:511] Master 127.20.34.126:41711 requested a full tablet report, sending...
I20260805 22:54:02.432979 26697 ts_manager.cc:194] Registered new tserver with Master: 8cc80422f9d0478488861c277ac1035c (127.20.34.67:37745)
I20260805 22:54:02.433792 26697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:49729
I20260805 22:54:02.436971 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:54:02.455595 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.441685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56366 (local address 127.20.34.126:41711)
0805 22:54:02.441883 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.441888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.442512 (+ 624us) server_negotiation.cc:407] Connection header received
0805 22:54:02.442664 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.442668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.442732 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.442868 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:02.444503 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.445250 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.446608 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.447058 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.447199 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.449717 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:02.449723 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:02.449726 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:02.449765 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:02.452631 (+ 2866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:02.453377 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:02.453383 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:02.453386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:02.453537 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:02.453953 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:02.453961 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:02.453965 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:02.454344 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:02.454622 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.454976 (+ 354us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.455232 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 22:54:02.460620 26697 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56366:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:54:02.468228 26697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:02.509074 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.486161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59628 (local address 127.20.34.65:37637)
0805 22:54:02.499030 (+ 12869us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.499043 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.499884 (+ 841us) server_negotiation.cc:407] Connection header received
0805 22:54:02.500021 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.500031 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.500362 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.500579 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:02.501566 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.503210 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.505829 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.507193 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.507351 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.507587 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.508474 (+ 887us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.508689 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12641,"thread_start_us":12454,"threads_started":1}
I20260805 22:54:02.509363 27388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.482470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:35867 (local address 127.0.0.1:37462)
0805 22:54:02.498995 (+ 16525us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:02.499022 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:02.499215 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:02.500803 (+ 1588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:02.500810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:02.500859 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:02.501770 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.501783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.503705 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.503710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.506018 (+ 2308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.506034 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.508262 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.508269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.508620 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.508652 (+ 32us) client_negotiation.cc:769] Sending connection context
0805 22:54:02.508754 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:54:02.508930 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16342,"mutex_wait_us":221,"spinlock_wait_cycles":14848,"thread_start_us":10886,"threads_started":1}
I20260805 22:54:02.510115 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.482580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37462 (local address 127.20.34.66:35867)
0805 22:54:02.498435 (+ 15855us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.498469 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.499972 (+ 1503us) server_negotiation.cc:407] Connection header received
0805 22:54:02.500087 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.500094 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.500371 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.500578 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:02.501985 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.503511 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.506221 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.507698 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.507865 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.508067 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.509594 (+ 1527us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.509808 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15588,"thread_start_us":15430,"threads_started":1}
I20260805 22:54:02.509946 27394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.485326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:37637 (local address 127.0.0.1:59628)
0805 22:54:02.499646 (+ 14320us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:02.499664 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:02.499824 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:02.500803 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:02.500810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:02.500853 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:02.501372 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.501383 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.503358 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.503363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.505623 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.505639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.507707 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.507712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.507960 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.508029 (+ 69us) client_negotiation.cc:769] Sending connection context
0805 22:54:02.508220 (+ 191us) client_negotiation.cc:240] Negotiation successful
0805 22:54:02.508558 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14188,"mutex_wait_us":214,"spinlock_wait_cycles":384,"thread_start_us":13910,"threads_started":1}
I20260805 22:54:02.511370 27390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.482171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:37745 (local address 127.0.0.1:35626)
0805 22:54:02.493974 (+ 11803us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:02.494053 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:02.495791 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:02.500891 (+ 5100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:02.500927 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:02.500963 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:02.501769 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.501783 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.505500 (+ 3717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.505512 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.508532 (+ 3020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.508547 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.510527 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.510534 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.510680 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.510711 (+ 31us) client_negotiation.cc:769] Sending connection context
0805 22:54:02.510824 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 22:54:02.510961 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11374,"mutex_wait_us":123,"thread_start_us":17260,"threads_started":1}
I20260805 22:54:02.511466 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.482453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35626 (local address 127.20.34.67:37745)
0805 22:54:02.499907 (+ 17454us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.499916 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.499944 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:54:02.500026 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.500032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.500363 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.500579 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:02.503473 (+ 2894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.505335 (+ 1862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.508750 (+ 3415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.510124 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.510301 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.510532 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.510883 (+ 351us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.511047 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17283,"thread_start_us":17105,"threads_started":1}
I20260805 22:54:02.514900 27278 tablet_service.cc:1467] Processing CreateTablet for tablet de044cc2d6aa46d5badac5de2d70e6a6 (DEFAULT_TABLE table=test-table [id=3cace589d1d249f980e529d91d82f0da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:02.514730 27087 tablet_service.cc:1467] Processing CreateTablet for tablet de044cc2d6aa46d5badac5de2d70e6a6 (DEFAULT_TABLE table=test-table [id=3cace589d1d249f980e529d91d82f0da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:02.516320 27278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de044cc2d6aa46d5badac5de2d70e6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:02.515791 26883 tablet_service.cc:1467] Processing CreateTablet for tablet de044cc2d6aa46d5badac5de2d70e6a6 (DEFAULT_TABLE table=test-table [id=3cace589d1d249f980e529d91d82f0da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:02.516395 27087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de044cc2d6aa46d5badac5de2d70e6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:02.517194 26883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de044cc2d6aa46d5badac5de2d70e6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:02.529213 27397 tablet_bootstrap.cc:492] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Bootstrap starting.
I20260805 22:54:02.533360 27397 tablet_bootstrap.cc:654] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:02.534441 27397 log.cc:824] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:02.535085 27400 tablet_bootstrap.cc:492] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Bootstrap starting.
I20260805 22:54:02.535477 27398 tablet_bootstrap.cc:492] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Bootstrap starting.
I20260805 22:54:02.539902 27400 tablet_bootstrap.cc:654] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:02.540431 27398 tablet_bootstrap.cc:654] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:02.541484 27400 log.cc:824] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:02.542138 27398 log.cc:824] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:02.544795 27397 tablet_bootstrap.cc:492] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: No bootstrap required, opened a new log
I20260805 22:54:02.544960 27400 tablet_bootstrap.cc:492] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: No bootstrap required, opened a new log
I20260805 22:54:02.545176 27397 ts_tablet_manager.cc:1397] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.009s
I20260805 22:54:02.545286 27400 ts_tablet_manager.cc:1397] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260805 22:54:02.553239 27397 raft_consensus.cc:348] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.553659 27397 raft_consensus.cc:374] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:02.553779 27397 raft_consensus.cc:729] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc80422f9d0478488861c277ac1035c, State: Initialized, Role: FOLLOWER
I20260805 22:54:02.553784 27400 raft_consensus.cc:348] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.554273 27398 tablet_bootstrap.cc:492] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: No bootstrap required, opened a new log
I20260805 22:54:02.554242 27400 raft_consensus.cc:374] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:02.554364 27400 raft_consensus.cc:729] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2142bb65b795463fa19af7ed7ba66157, State: Initialized, Role: FOLLOWER
I20260805 22:54:02.554610 27398 ts_tablet_manager.cc:1397] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.004s
I20260805 22:54:02.554489 27397 consensus_queue.cc:260] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.554991 27400 consensus_queue.cc:260] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.555869 27366 heartbeater.cc:503] Master 127.20.34.126:41711 was elected leader, sending a full tablet report...
I20260805 22:54:02.556644 27397 ts_tablet_manager.cc:1428] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260805 22:54:02.557623 27182 heartbeater.cc:503] Master 127.20.34.126:41711 was elected leader, sending a full tablet report...
I20260805 22:54:02.559994 27400 ts_tablet_manager.cc:1428] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Time spent starting tablet: real 0.015s user 0.000s sys 0.013s
I20260805 22:54:02.565943 27398 raft_consensus.cc:348] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.566380 27398 raft_consensus.cc:374] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:02.566515 27398 raft_consensus.cc:729] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aff144c91e24443b79c727726f9952f, State: Initialized, Role: FOLLOWER
I20260805 22:54:02.567203 27398 consensus_queue.cc:260] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.568991 27398 ts_tablet_manager.cc:1428] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
W20260805 22:54:02.602530 27185 tablet.cc:2369] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:54:02.657876 27367 tablet.cc:2369] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:54:02.730958 27406 raft_consensus.cc:482] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:02.731353 27406 raft_consensus.cc:504] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.733253 27406 leader_election.cc:288] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cc80422f9d0478488861c277ac1035c (127.20.34.67:37745), 7aff144c91e24443b79c727726f9952f (127.20.34.65:37637)
I20260805 22:54:02.741384 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.733695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:54613 (local address 127.20.34.67:37745)
0805 22:54:02.733942 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.733948 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.735061 (+ 1113us) server_negotiation.cc:407] Connection header received
0805 22:54:02.735292 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.735302 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.735369 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.735471 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:02.736075 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.736880 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.738866 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.740133 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.740332 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.740412 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.740960 (+ 548us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.741093 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260805 22:54:02.741523 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.733771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:56761 (local address 127.20.34.65:37637)
0805 22:54:02.733998 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.734006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.735115 (+ 1109us) server_negotiation.cc:407] Connection header received
0805 22:54:02.735326 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.735331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.735399 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.735497 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:02.736209 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.737137 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.739259 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.740487 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.740613 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.740663 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.741124 (+ 461us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.741253 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:54:02.741576 27408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.733740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:37745 (local address 127.20.34.66:54613)
0805 22:54:02.734940 (+ 1200us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:02.734956 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:02.735140 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:02.735490 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:02.735494 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:02.735530 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:02.735921 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.735931 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.737018 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.737025 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.738681 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.738698 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.740605 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.740612 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.740754 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.740784 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 22:54:02.740934 (+ 150us) client_negotiation.cc:240] Negotiation successful
0805 22:54:02.741082 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1073,"mutex_wait_us":1,"thread_start_us":647,"threads_started":1}
I20260805 22:54:02.742060 27409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.733891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:37637 (local address 127.20.34.66:56761)
0805 22:54:02.734994 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:02.735009 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:02.735176 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:02.735511 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:02.735515 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:02.735606 (+ 91us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:02.736030 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.736039 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.737292 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.737296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.739059 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:02.739078 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.740830 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.740834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:02.740970 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.740992 (+ 22us) client_negotiation.cc:769] Sending connection context
0805 22:54:02.741095 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:54:02.741229 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1001,"mutex_wait_us":1,"spinlock_wait_cycles":25856,"thread_start_us":661,"threads_started":1}
I20260805 22:54:02.742727 27302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de044cc2d6aa46d5badac5de2d70e6a6" candidate_uuid: "2142bb65b795463fa19af7ed7ba66157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cc80422f9d0478488861c277ac1035c" is_pre_election: true
I20260805 22:54:02.743093 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de044cc2d6aa46d5badac5de2d70e6a6" candidate_uuid: "2142bb65b795463fa19af7ed7ba66157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aff144c91e24443b79c727726f9952f" is_pre_election: true
I20260805 22:54:02.743286 27302 raft_consensus.cc:2454] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2142bb65b795463fa19af7ed7ba66157 in term 0.
I20260805 22:54:02.743630 26914 raft_consensus.cc:2454] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2142bb65b795463fa19af7ed7ba66157 in term 0.
I20260805 22:54:02.744061 27022 leader_election.cc:302] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2142bb65b795463fa19af7ed7ba66157, 8cc80422f9d0478488861c277ac1035c; no voters:
I20260805 22:54:02.744562 27406 raft_consensus.cc:2781] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:02.744714 27406 raft_consensus.cc:482] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:02.744829 27406 raft_consensus.cc:3037] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:02.747267 27406 raft_consensus.cc:504] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.747984 27406 leader_election.cc:288] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [CANDIDATE]: Term 1 election: Requested vote from peers 8cc80422f9d0478488861c277ac1035c (127.20.34.67:37745), 7aff144c91e24443b79c727726f9952f (127.20.34.65:37637)
I20260805 22:54:02.748499 27302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de044cc2d6aa46d5badac5de2d70e6a6" candidate_uuid: "2142bb65b795463fa19af7ed7ba66157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cc80422f9d0478488861c277ac1035c"
I20260805 22:54:02.748626 26914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de044cc2d6aa46d5badac5de2d70e6a6" candidate_uuid: "2142bb65b795463fa19af7ed7ba66157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aff144c91e24443b79c727726f9952f"
I20260805 22:54:02.748747 27302 raft_consensus.cc:3037] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:02.748847 26914 raft_consensus.cc:3037] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:02.752110 27302 raft_consensus.cc:2454] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2142bb65b795463fa19af7ed7ba66157 in term 1.
I20260805 22:54:02.752110 26914 raft_consensus.cc:2454] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2142bb65b795463fa19af7ed7ba66157 in term 1.
I20260805 22:54:02.752624 27028 leader_election.cc:302] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2142bb65b795463fa19af7ed7ba66157, 7aff144c91e24443b79c727726f9952f; no voters:
I20260805 22:54:02.752985 27406 raft_consensus.cc:2781] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:02.753486 27406 raft_consensus.cc:686] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 1 LEADER]: Becoming Leader. State: Replica: 2142bb65b795463fa19af7ed7ba66157, State: Running, Role: LEADER
I20260805 22:54:02.754029 27406 consensus_queue.cc:237] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } }
I20260805 22:54:02.759339 26696 catalog_manager.cc:5495] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2142bb65b795463fa19af7ed7ba66157 (127.20.34.66). New cstate: current_term: 1 leader_uuid: "2142bb65b795463fa19af7ed7ba66157" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2142bb65b795463fa19af7ed7ba66157" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 } health_report { overall_health: UNKNOWN } } }
W20260805 22:54:02.802294 26989 tablet.cc:2369] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:54:02.812402 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.805738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37466 (local address 127.20.34.66:35867)
0805 22:54:02.806150 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.806154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.806173 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:54:02.806267 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.806271 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.806355 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.806498 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:02.807123 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.807830 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.809426 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.809995 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.810162 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.810731 (+ 569us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:02.811648 (+ 917us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:02.811802 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.812014 (+ 212us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.812094 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282}
I20260805 22:54:02.821225 27302 raft_consensus.cc:1261] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 1 FOLLOWER]: Refusing update from remote peer 2142bb65b795463fa19af7ed7ba66157: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:02.821225 26914 raft_consensus.cc:1261] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 1 FOLLOWER]: Refusing update from remote peer 2142bb65b795463fa19af7ed7ba66157: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:02.822415 27413 consensus_queue.cc:1035] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cc80422f9d0478488861c277ac1035c" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:02.822875 27406 consensus_queue.cc:1035] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aff144c91e24443b79c727726f9952f" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 37637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:02.836019 27418 mvcc.cc:205] Tried to move back new op lower bound from 7315334933784637440 to 7315334933524430848. Current Snapshot: MvccSnapshot[applied={T|T < 7315334933784637440}]
I20260805 22:54:02.853204 26697 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:02.853577 26697 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:02.858137 26697 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ee82735cdc04d348ac0f64f6bc9fa91: Sending DeleteTablet for 3 replicas of tablet de044cc2d6aa46d5badac5de2d70e6a6
I20260805 22:54:02.859781 27087 tablet_service.cc:1514] Processing DeleteTablet for tablet de044cc2d6aa46d5badac5de2d70e6a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:37462
I20260805 22:54:02.860080 27278 tablet_service.cc:1514] Processing DeleteTablet for tablet de044cc2d6aa46d5badac5de2d70e6a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:35626
I20260805 22:54:02.860877 26883 tablet_service.cc:1514] Processing DeleteTablet for tablet de044cc2d6aa46d5badac5de2d70e6a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:59628
I20260805 22:54:02.863770 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 26791
I20260805 22:54:02.864746 27438 tablet_replica.cc:330] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: stopping tablet replica
I20260805 22:54:02.865355 27438 raft_consensus.cc:2229] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:02.865994 27438 raft_consensus.cc:2258] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:02.866901 27440 tablet_replica.cc:330] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: stopping tablet replica
I20260805 22:54:02.867357 27440 raft_consensus.cc:2229] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:02.867871 27440 raft_consensus.cc:2258] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:02.868835 27438 ts_tablet_manager.cc:1905] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:02.875965 27440 ts_tablet_manager.cc:1905] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:02.876735 27436 tablet_replica.cc:330] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: stopping tablet replica
I20260805 22:54:02.877322 27436 raft_consensus.cc:2229] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:54:02.878139 27436 raft_consensus.cc:2258] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:02.878713 27438 ts_tablet_manager.cc:1918] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:02.879048 27438 log.cc:1196] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/de044cc2d6aa46d5badac5de2d70e6a6
I20260805 22:54:02.879668 27438 ts_tablet_manager.cc:1939] T de044cc2d6aa46d5badac5de2d70e6a6 P 8cc80422f9d0478488861c277ac1035c: Deleting consensus metadata
I20260805 22:54:02.880908 27436 ts_tablet_manager.cc:1905] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:02.881844 26675 catalog_manager.cc:4841] TS 8cc80422f9d0478488861c277ac1035c (127.20.34.67:37745): tablet de044cc2d6aa46d5badac5de2d70e6a6 (table test-table [id=3cace589d1d249f980e529d91d82f0da]) successfully deleted
I20260805 22:54:02.886667 27440 ts_tablet_manager.cc:1918] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:02.886916 27440 log.cc:1196] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/de044cc2d6aa46d5badac5de2d70e6a6
I20260805 22:54:02.887619 27440 ts_tablet_manager.cc:1939] T de044cc2d6aa46d5badac5de2d70e6a6 P 7aff144c91e24443b79c727726f9952f: Deleting consensus metadata
I20260805 22:54:02.889020 27436 ts_tablet_manager.cc:1918] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:02.889215 27436 log.cc:1196] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/de044cc2d6aa46d5badac5de2d70e6a6
I20260805 22:54:02.889863 27436 ts_tablet_manager.cc:1939] T de044cc2d6aa46d5badac5de2d70e6a6 P 2142bb65b795463fa19af7ed7ba66157: Deleting consensus metadata
I20260805 22:54:02.890122 26678 catalog_manager.cc:4841] TS 7aff144c91e24443b79c727726f9952f (127.20.34.65:37637): tablet de044cc2d6aa46d5badac5de2d70e6a6 (table test-table [id=3cace589d1d249f980e529d91d82f0da]) successfully deleted
I20260805 22:54:02.892102 26677 catalog_manager.cc:4841] TS 2142bb65b795463fa19af7ed7ba66157 (127.20.34.66:35867): tablet de044cc2d6aa46d5badac5de2d70e6a6 (table test-table [id=3cace589d1d249f980e529d91d82f0da]) successfully deleted
Aug 05 22:54:02 dist-test-slave-gmjp krb5kdc[26637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:54:02.906003 27396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:02.867016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59642 (local address 127.20.34.65:37637)
0805 22:54:02.867198 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:02.867204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:02.889907 (+ 22703us) server_negotiation.cc:407] Connection header received
0805 22:54:02.890616 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:02.890621 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:02.890701 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:02.890833 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:02.892268 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.893049 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.894335 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:02.894758 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:02.894914 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:02.899588 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:02.899601 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:02.899618 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:02.899657 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:02.902718 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:02.903700 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:02.903709 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:02.903711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:02.903891 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:02.904432 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:02.904436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:02.904438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:02.904851 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:02.905101 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:02.905446 (+ 345us) server_negotiation.cc:299] Negotiation successful
0805 22:54:02.905632 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 22:54:02.906742 26981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:03.009554 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 26791
I20260805 22:54:03.038690 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 26998
Aug 05 22:54:03 dist-test-slave-gmjp krb5kdc[26637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:54:03.056980 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:03.039607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37480 (local address 127.20.34.66:35867)
0805 22:54:03.039790 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:03.039797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:03.039900 (+ 103us) server_negotiation.cc:407] Connection header received
0805 22:54:03.040124 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:03.040134 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:03.040262 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:03.040386 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:03.041702 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:03.042565 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:03.043881 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:03.044615 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:03.044767 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:03.049656 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:03.049672 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:03.049692 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:03.049747 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:03.053734 (+ 3987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:03.054504 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:03.054513 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:03.054517 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:03.054700 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:03.055095 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:03.055101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:03.055104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:03.055644 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:03.055964 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:03.056227 (+ 263us) server_negotiation.cc:299] Negotiation successful
0805 22:54:03.056520 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:54:03.057768 27176 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:03.179549 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 26998
I20260805 22:54:03.209741 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 27192
Aug 05 22:54:03 dist-test-slave-gmjp krb5kdc[26637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:54:03.226402 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:03.210584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35642 (local address 127.20.34.67:37745)
0805 22:54:03.210805 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:03.210814 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:03.210837 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:54:03.211102 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:03.211106 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:03.211189 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:03.211316 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:03.212818 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:03.213565 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:03.214835 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:03.215331 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:03.215474 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:03.220023 (+ 4549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:03.220043 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:03.220061 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:03.220101 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:03.223217 (+ 3116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:03.224024 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:03.224033 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:03.224035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:03.224252 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:03.224663 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:03.224669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:03.224672 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:03.225088 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:03.225406 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:03.225769 (+ 363us) server_negotiation.cc:299] Negotiation successful
0805 22:54:03.226029 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 22:54:03.227139 27358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:03.319029 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 27192
I20260805 22:54:03.346961 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 26654
I20260805 22:54:03.348269 26743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:03.466457 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 26654
2026-08-05T22:54:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4926 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-05T22:54:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:03Z Disabled control of system clock
I20260805 22:54:03.560048 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45357
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:38291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:45357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:54:03.914319 27450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:03.914634 27450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:03.914813 27450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:03.922415 27450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:03.922530 27450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:03.922616 27450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:03.922710 27450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:03.922797 27450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:03.932660 27450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:45357
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:03.934103 27450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:03.936079 27450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:03.948475 27459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:03.948693 27466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:03.948877 27461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:03.950136 27450 server_base.cc:1034] running on GCE node
I20260805 22:54:03.951014 27450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:03.952670 27450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:03.953922 27450 hybrid_clock.cc:648] HybridClock initialized: now 1785970443953884 us; error 65 us; skew 500 ppm
I20260805 22:54:03.954303 27450 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:03.956962 27450 webserver.cc:460] Webserver started at http://127.20.34.126:38143/ using document root <none> and password file <none>
I20260805 22:54:03.957752 27450 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:03.957896 27450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:03.958262 27450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:03.961611 27450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "8cfa5f1f4c994c54a62a8808c9b53174"
format_stamp: "Formatted at 2026-08-05 22:54:03 on dist-test-slave-gmjp"
server_key: "3cedec6ba3cf9ffb5e9f1fb49a6db611"
server_key_iv: "2bc0169897b0075e5a544539f5807497"
server_key_version: "encryptionkey@0"
I20260805 22:54:03.962484 27450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "8cfa5f1f4c994c54a62a8808c9b53174"
format_stamp: "Formatted at 2026-08-05 22:54:03 on dist-test-slave-gmjp"
server_key: "3cedec6ba3cf9ffb5e9f1fb49a6db611"
server_key_iv: "2bc0169897b0075e5a544539f5807497"
server_key_version: "encryptionkey@0"
I20260805 22:54:03.967957 27450 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260805 22:54:03.971508 27475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:03.973102 27450 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:03.973305 27450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "8cfa5f1f4c994c54a62a8808c9b53174"
format_stamp: "Formatted at 2026-08-05 22:54:03 on dist-test-slave-gmjp"
server_key: "3cedec6ba3cf9ffb5e9f1fb49a6db611"
server_key_iv: "2bc0169897b0075e5a544539f5807497"
server_key_version: "encryptionkey@0"
I20260805 22:54:03.973577 27450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:03.980407 27450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:03.981254 27450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:03.981575 27450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:04.001679 27450 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:45357
I20260805 22:54:04.001783 27543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:45357 every 8 connection(s)
I20260805 22:54:04.003160 27450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:04.007404 27544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:04.008049 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 27450
I20260805 22:54:04.008281 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:04.008996 20617 external_mini_cluster.cc:1428] Setting key 16c7c64189e5b5d174b5359eb0479c3b
I20260805 22:54:04.018129 27548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:04.011353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40658 (local address 127.20.34.126:45357)
0805 22:54:04.012551 (+ 1198us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:04.012563 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:04.012608 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:54:04.014219 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:04.014245 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:04.014721 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:04.015081 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:04.016341 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:04.016348 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:04.016362 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:04.016378 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:04.016452 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:04.016469 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:04.016644 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:04.016809 (+ 165us) server_negotiation.cc:299] Negotiation successful
0805 22:54:04.017086 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":445,"threads_started":1}
I20260805 22:54:04.022001 27544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174: Bootstrap starting.
I20260805 22:54:04.025602 27544 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:04.026708 27544 log.cc:824] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:04.029984 27544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174: No bootstrap required, opened a new log
I20260805 22:54:04.038025 27544 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cfa5f1f4c994c54a62a8808c9b53174" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45357 } }
I20260805 22:54:04.038483 27544 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:04.038630 27544 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cfa5f1f4c994c54a62a8808c9b53174, State: Initialized, Role: FOLLOWER
I20260805 22:54:04.039290 27544 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cfa5f1f4c994c54a62a8808c9b53174" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45357 } }
I20260805 22:54:04.039542 27544 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:04.039683 27544 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:04.039870 27544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:04.042526 27544 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cfa5f1f4c994c54a62a8808c9b53174" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45357 } }
I20260805 22:54:04.043097 27544 leader_election.cc:302] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cfa5f1f4c994c54a62a8808c9b53174; no voters:
I20260805 22:54:04.043751 27544 leader_election.cc:288] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:04.043915 27550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:04.044732 27550 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [term 1 LEADER]: Becoming Leader. State: Replica: 8cfa5f1f4c994c54a62a8808c9b53174, State: Running, Role: LEADER
I20260805 22:54:04.045367 27550 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cfa5f1f4c994c54a62a8808c9b53174" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45357 } }
I20260805 22:54:04.046037 27544 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:04.048714 27555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cfa5f1f4c994c54a62a8808c9b53174. Latest consensus state: current_term: 1 leader_uuid: "8cfa5f1f4c994c54a62a8808c9b53174" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cfa5f1f4c994c54a62a8808c9b53174" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45357 } } }
I20260805 22:54:04.049250 27555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:04.048781 27552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cfa5f1f4c994c54a62a8808c9b53174" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cfa5f1f4c994c54a62a8808c9b53174" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45357 } } }
I20260805 22:54:04.050028 27552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:04.058616 27563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:04.064481 27563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:04.074883 27563 catalog_manager.cc:1347] Generated new cluster ID: 308446b580b943e28a54d8a5db8f3832
I20260805 22:54:04.075024 27563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:04.091449 27563 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:04.091943 27563 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:04.103930 27563 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174: Generated new TSK 0
I20260805 22:54:04.104925 27563 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:54:04.120460 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45357
--builtin_ntp_servers=127.20.34.84:38291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 22:54:04.528976 27578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:04.529271 27578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:04.529422 27578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:04.536974 27578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:04.537096 27578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:04.537276 27578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:54:04.547582 27578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:04.549248 27578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:04.551318 27578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:04.565722 27586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:04.565827 27588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:04.565757 27592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:04.566708 27578 server_base.cc:1034] running on GCE node
I20260805 22:54:04.567448 27578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:04.568715 27578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:04.570039 27578 hybrid_clock.cc:648] HybridClock initialized: now 1785970444569933 us; error 90 us; skew 500 ppm
I20260805 22:54:04.570374 27578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:04.573029 27578 webserver.cc:460] Webserver started at http://127.20.34.65:35169/ using document root <none> and password file <none>
I20260805 22:54:04.573781 27578 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:04.573881 27578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:04.574182 27578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:04.577400 27578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "4f6371f79199478a9cbfe18b0cab38fa"
format_stamp: "Formatted at 2026-08-05 22:54:04 on dist-test-slave-gmjp"
server_key: "8fb1e72e4b9895ab0d9389ce1f6aafa4"
server_key_iv: "a01a8c482e302d4dfad5d7b267e06523"
server_key_version: "encryptionkey@0"
I20260805 22:54:04.578349 27578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "4f6371f79199478a9cbfe18b0cab38fa"
format_stamp: "Formatted at 2026-08-05 22:54:04 on dist-test-slave-gmjp"
server_key: "8fb1e72e4b9895ab0d9389ce1f6aafa4"
server_key_iv: "a01a8c482e302d4dfad5d7b267e06523"
server_key_version: "encryptionkey@0"
I20260805 22:54:04.584106 27578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:54:04.588115 27599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:04.589810 27578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:04.590031 27578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "4f6371f79199478a9cbfe18b0cab38fa"
format_stamp: "Formatted at 2026-08-05 22:54:04 on dist-test-slave-gmjp"
server_key: "8fb1e72e4b9895ab0d9389ce1f6aafa4"
server_key_iv: "a01a8c482e302d4dfad5d7b267e06523"
server_key_version: "encryptionkey@0"
I20260805 22:54:04.590283 27578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:04.596675 27578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:04.597602 27578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:04.597901 27578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:04.599089 27578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:04.600736 27578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:04.600853 27578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:04.600991 27578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:04.601073 27578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:04.637725 27578 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34525
I20260805 22:54:04.637778 27766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34525 every 8 connection(s)
I20260805 22:54:04.639290 27578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:54:04.640231 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 27578
I20260805 22:54:04.640489 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:54:04.641444 20617 external_mini_cluster.cc:1428] Setting key a59bcd0461b2bf8127b9a3e43540858e
I20260805 22:54:04.645015 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45357
--builtin_ntp_servers=127.20.34.84:38291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260805 22:54:04.649232 27770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:04.642824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:37043 (local address 127.20.34.126:45357)
0805 22:54:04.643342 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:04.643349 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:04.644685 (+ 1336us) server_negotiation.cc:407] Connection header received
0805 22:54:04.646645 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:04.646651 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:04.646737 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:04.646881 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:04.648409 (+ 1528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:04.648415 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:04.648420 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:04.648448 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:04.648494 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:04.648506 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:04.648642 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:04.648847 (+ 205us) server_negotiation.cc:299] Negotiation successful
0805 22:54:04.648922 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":235,"threads_started":1}
I20260805 22:54:04.650269 27771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:04.643335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45357 (local address 127.20.34.65:37043)
0805 22:54:04.644513 (+ 1178us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:04.644563 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:04.646342 (+ 1779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:04.647127 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:04.647135 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:04.647234 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:04.648021 (+ 787us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:54:04.648024 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:04.648079 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:54:04.648230 (+ 151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:04.648610 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:04.648622 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:04.648629 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:54:04.648947 (+ 318us) client_negotiation.cc:240] Negotiation successful
0805 22:54:04.649226 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":394,"threads_started":1}
I20260805 22:54:04.652015 27767 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45357
I20260805 22:54:04.652387 27767 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:04.653047 27767 heartbeater.cc:511] Master 127.20.34.126:45357 requested a full tablet report, sending...
I20260805 22:54:04.655370 27497 ts_manager.cc:194] Registered new tserver with Master: 4f6371f79199478a9cbfe18b0cab38fa (127.20.34.65:34525)
W20260805 22:54:05.006964 27773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:05.007344 27773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:05.007515 27773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:05.015127 27773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:05.015300 27773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:05.015506 27773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:54:05.025159 27773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:05.026608 27773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:05.028611 27773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:05.042313 27781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:05.042245 27782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:05.042411 27784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:05.043046 27773 server_base.cc:1034] running on GCE node
I20260805 22:54:05.043771 27773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:05.044881 27773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:05.046128 27773 hybrid_clock.cc:648] HybridClock initialized: now 1785970445046071 us; error 54 us; skew 500 ppm
I20260805 22:54:05.046509 27773 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:05.049366 27773 webserver.cc:460] Webserver started at http://127.20.34.66:37109/ using document root <none> and password file <none>
I20260805 22:54:05.050123 27773 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:05.050271 27773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:05.050650 27773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:05.053998 27773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "9e2c67c7861d4a428135f7ed9149f9e8"
format_stamp: "Formatted at 2026-08-05 22:54:05 on dist-test-slave-gmjp"
server_key: "4d11a3aa3ab6ea6cc69a42b3e4417eb6"
server_key_iv: "76752c31a8f9a38df40063b1f8a6663b"
server_key_version: "encryptionkey@0"
I20260805 22:54:05.054898 27773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "9e2c67c7861d4a428135f7ed9149f9e8"
format_stamp: "Formatted at 2026-08-05 22:54:05 on dist-test-slave-gmjp"
server_key: "4d11a3aa3ab6ea6cc69a42b3e4417eb6"
server_key_iv: "76752c31a8f9a38df40063b1f8a6663b"
server_key_version: "encryptionkey@0"
I20260805 22:54:05.060626 27773 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260805 22:54:05.064512 27794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:05.065943 27773 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:05.066144 27773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "9e2c67c7861d4a428135f7ed9149f9e8"
format_stamp: "Formatted at 2026-08-05 22:54:05 on dist-test-slave-gmjp"
server_key: "4d11a3aa3ab6ea6cc69a42b3e4417eb6"
server_key_iv: "76752c31a8f9a38df40063b1f8a6663b"
server_key_version: "encryptionkey@0"
I20260805 22:54:05.066411 27773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:05.072893 27773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:05.073818 27773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:05.074131 27773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:05.075215 27773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:05.076915 27773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:05.077047 27773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:05.077198 27773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:05.077289 27773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:05.113233 27773 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:35387
I20260805 22:54:05.113339 27961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:35387 every 8 connection(s)
I20260805 22:54:05.114655 27773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:54:05.123812 27770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.117693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:33425 (local address 127.20.34.126:45357)
0805 22:54:05.117915 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:05.117920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:05.119564 (+ 1644us) server_negotiation.cc:407] Connection header received
0805 22:54:05.121492 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:05.121498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:05.121579 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:05.121678 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:05.123184 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:05.123189 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:05.123192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:05.123211 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:05.123245 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:05.123257 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:05.123378 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:05.123551 (+ 173us) server_negotiation.cc:299] Negotiation successful
0805 22:54:05.123607 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260805 22:54:05.124418 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 27773
I20260805 22:54:05.124555 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:54:05.124969 20617 external_mini_cluster.cc:1428] Setting key 673b8980109cc046ecb06899ce6b549c
I20260805 22:54:05.124963 27967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.118305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45357 (local address 127.20.34.66:33425)
0805 22:54:05.119371 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:05.119418 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:05.121174 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:05.121918 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:05.121928 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:05.122034 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:05.122848 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:54:05.122850 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:05.122894 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:54:05.122994 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:05.123355 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:05.123364 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:05.123370 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:54:05.123610 (+ 240us) client_negotiation.cc:240] Negotiation successful
0805 22:54:05.123842 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":319,"threads_started":1}
I20260805 22:54:05.126691 27962 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45357
I20260805 22:54:05.127064 27962 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:05.127736 27962 heartbeater.cc:511] Master 127.20.34.126:45357 requested a full tablet report, sending...
I20260805 22:54:05.128078 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45357
--builtin_ntp_servers=127.20.34.84:38291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260805 22:54:05.129415 27497 ts_manager.cc:194] Registered new tserver with Master: 9e2c67c7861d4a428135f7ed9149f9e8 (127.20.34.66:35387)
W20260805 22:54:05.499879 27969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:05.500263 27969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:05.500377 27969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:05.507922 27969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:05.508067 27969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:05.508268 27969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:54:05.517980 27969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:05.519416 27969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:05.521437 27969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:05.535686 27984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:05.535661 27980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:05.535974 27979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:05.536747 27969 server_base.cc:1034] running on GCE node
I20260805 22:54:05.537431 27969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:05.538504 27969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:05.539712 27969 hybrid_clock.cc:648] HybridClock initialized: now 1785970445539664 us; error 49 us; skew 500 ppm
I20260805 22:54:05.540093 27969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:05.542676 27969 webserver.cc:460] Webserver started at http://127.20.34.67:39981/ using document root <none> and password file <none>
I20260805 22:54:05.543455 27969 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:05.543558 27969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:05.543954 27969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:05.547150 27969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "7448d4bc62f54c8b86cc1031f3330ac7"
format_stamp: "Formatted at 2026-08-05 22:54:05 on dist-test-slave-gmjp"
server_key: "ef34a4b27780b3538492ab46f7e75659"
server_key_iv: "0fb63e032274b00f43d5564235448138"
server_key_version: "encryptionkey@0"
I20260805 22:54:05.548120 27969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "7448d4bc62f54c8b86cc1031f3330ac7"
format_stamp: "Formatted at 2026-08-05 22:54:05 on dist-test-slave-gmjp"
server_key: "ef34a4b27780b3538492ab46f7e75659"
server_key_iv: "0fb63e032274b00f43d5564235448138"
server_key_version: "encryptionkey@0"
I20260805 22:54:05.553988 27969 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:54:05.557473 27994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:05.558846 27969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:05.559072 27969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "7448d4bc62f54c8b86cc1031f3330ac7"
format_stamp: "Formatted at 2026-08-05 22:54:05 on dist-test-slave-gmjp"
server_key: "ef34a4b27780b3538492ab46f7e75659"
server_key_iv: "0fb63e032274b00f43d5564235448138"
server_key_version: "encryptionkey@0"
I20260805 22:54:05.559310 27969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:05.565354 27969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:05.566215 27969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:05.566517 27969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:05.567484 27969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:05.569058 27969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:05.569190 27969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:05.569334 27969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:05.569430 27969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:05.605392 27969 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:34567
I20260805 22:54:05.605450 28165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:34567 every 8 connection(s)
I20260805 22:54:05.606798 27969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:54:05.614353 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 27969
I20260805 22:54:05.614559 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:54:05.615226 20617 external_mini_cluster.cc:1428] Setting key c51e8e985daa9979aeb8816cddcd7c73
I20260805 22:54:05.615733 27770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.609693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:47291 (local address 127.20.34.126:45357)
0805 22:54:05.609905 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:05.609910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:05.611335 (+ 1425us) server_negotiation.cc:407] Connection header received
0805 22:54:05.613154 (+ 1819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:05.613159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:05.613220 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:05.613315 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:05.614931 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:05.614937 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:05.614943 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:05.614973 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:05.615008 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:05.615021 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:05.615169 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:05.615421 (+ 252us) server_negotiation.cc:299] Negotiation successful
0805 22:54:05.615495 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 22:54:05.618696 28169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.610162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45357 (local address 127.20.34.67:47291)
0805 22:54:05.611153 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:05.611192 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:05.612864 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:05.613541 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:05.613549 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:05.613670 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:05.614535 (+ 865us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:54:05.614539 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:05.614599 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:54:05.614736 (+ 137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:05.615121 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:05.615132 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:05.615144 (+ 12us) client_negotiation.cc:769] Sending connection context
0805 22:54:05.616786 (+ 1642us) client_negotiation.cc:240] Negotiation successful
0805 22:54:05.617113 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":298,"threads_started":1}
I20260805 22:54:05.625871 28167 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45357
I20260805 22:54:05.626282 28167 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:05.627022 28167 heartbeater.cc:511] Master 127.20.34.126:45357 requested a full tablet report, sending...
I20260805 22:54:05.628937 27497 ts_manager.cc:194] Registered new tserver with Master: 7448d4bc62f54c8b86cc1031f3330ac7 (127.20.34.67:34567)
I20260805 22:54:05.634310 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:54:05.643648 27770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.640352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40666 (local address 127.20.34.126:45357)
0805 22:54:05.641107 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:05.641117 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:05.641146 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:54:05.641332 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:05.641340 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:05.641424 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:05.641553 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:05.642771 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:05.642780 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:05.642788 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:05.642816 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:05.642900 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:05.642922 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:05.643069 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:05.643193 (+ 124us) server_negotiation.cc:299] Negotiation successful
0805 22:54:05.643269 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579}
I20260805 22:54:05.658609 27767 heartbeater.cc:503] Master 127.20.34.126:45357 was elected leader, sending a full tablet report...
I20260805 22:54:05.649243 27497 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40666:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:54:05.663264 27497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:05.711298 28183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.680596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55266 (local address 127.20.34.66:35387)
0805 22:54:05.695014 (+ 14418us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:05.695027 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:05.704652 (+ 9625us) server_negotiation.cc:407] Connection header received
0805 22:54:05.704757 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:05.704769 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:05.705119 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:05.705311 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:05.710284 (+ 4973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:05.710296 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:05.710316 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:05.710352 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:05.710408 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:05.710425 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:05.710591 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:05.710798 (+ 207us) server_negotiation.cc:299] Negotiation successful
0805 22:54:05.710926 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14180,"thread_start_us":14424,"threads_started":1}
I20260805 22:54:05.711402 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.680478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34567 (local address 127.0.0.1:37044)
0805 22:54:05.692299 (+ 11821us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:05.692356 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:05.692550 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:05.708072 (+ 15522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:05.708080 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:05.708114 (+ 34us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:05.709984 (+ 1870us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:54:05.709990 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:05.710014 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:54:05.710077 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:05.710590 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:05.710598 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:05.710606 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 22:54:05.710762 (+ 156us) client_negotiation.cc:240] Negotiation successful
0805 22:54:05.710898 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11469,"thread_start_us":11272,"threads_started":1}
I20260805 22:54:05.712128 28186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.682299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34525 (local address 127.0.0.1:42454)
0805 22:54:05.706691 (+ 24392us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:05.706707 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:05.706843 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:05.709264 (+ 2421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:05.709269 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:05.709293 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:05.710751 (+ 1458us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:54:05.710754 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:05.710770 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:54:05.710811 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:05.711362 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:05.711370 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:05.711377 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:54:05.711542 (+ 165us) client_negotiation.cc:240] Negotiation successful
0805 22:54:05.711590 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24278,"thread_start_us":21675,"threads_started":1}
I20260805 22:54:05.712495 28185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.680997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37044 (local address 127.20.34.67:34567)
0805 22:54:05.707558 (+ 26561us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:05.707566 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:05.707600 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:54:05.707674 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:05.707680 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:05.707840 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:05.708009 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:05.710301 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:05.710314 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:05.710331 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:05.710358 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:05.710431 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:05.710457 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:05.711759 (+ 1302us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:05.711849 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 22:54:05.711965 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26330,"thread_start_us":26132,"threads_started":1}
I20260805 22:54:05.712900 28188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.683025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42454 (local address 127.20.34.65:34525)
0805 22:54:05.703773 (+ 20748us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:05.703786 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:05.706839 (+ 3053us) server_negotiation.cc:407] Connection header received
0805 22:54:05.707477 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:05.707490 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:05.707756 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:05.707941 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:05.711000 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:05.711009 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:05.711022 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:05.711042 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:05.711106 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:05.711125 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:05.711299 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:05.712442 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0805 22:54:05.712534 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20510,"thread_start_us":20340,"threads_started":1}
I20260805 22:54:05.713318 28187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:05.680478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:35387 (local address 127.0.0.1:55266)
0805 22:54:05.704317 (+ 23839us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:05.704339 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:05.704471 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:05.705344 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:05.705352 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:05.705473 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:05.709921 (+ 4448us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:54:05.709926 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:05.709963 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:54:05.710062 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:05.710542 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:05.710554 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:05.710562 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 22:54:05.712717 (+ 2155us) client_negotiation.cc:240] Negotiation successful
0805 22:54:05.712784 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23683,"mutex_wait_us":839,"thread_start_us":25098,"threads_started":1}
I20260805 22:54:05.717075 27672 tablet_service.cc:1467] Processing CreateTablet for tablet b92e676d6fc746e48cb61224c2eb3bce (DEFAULT_TABLE table=test-table [id=79498f3de81f49e9a1025a532dd07d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:05.717373 28063 tablet_service.cc:1467] Processing CreateTablet for tablet b92e676d6fc746e48cb61224c2eb3bce (DEFAULT_TABLE table=test-table [id=79498f3de81f49e9a1025a532dd07d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:05.718456 27672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b92e676d6fc746e48cb61224c2eb3bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:05.718885 28063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b92e676d6fc746e48cb61224c2eb3bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:05.728222 27869 tablet_service.cc:1467] Processing CreateTablet for tablet b92e676d6fc746e48cb61224c2eb3bce (DEFAULT_TABLE table=test-table [id=79498f3de81f49e9a1025a532dd07d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:05.730705 27869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b92e676d6fc746e48cb61224c2eb3bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:05.738993 28189 tablet_bootstrap.cc:492] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Bootstrap starting.
I20260805 22:54:05.743764 28190 tablet_bootstrap.cc:492] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Bootstrap starting.
I20260805 22:54:05.745352 28189 tablet_bootstrap.cc:654] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:05.747359 28189 log.cc:824] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:05.749734 28190 tablet_bootstrap.cc:654] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:05.751377 28190 log.cc:824] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:05.758433 28189 tablet_bootstrap.cc:492] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: No bootstrap required, opened a new log
I20260805 22:54:05.758780 28194 tablet_bootstrap.cc:492] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Bootstrap starting.
I20260805 22:54:05.758939 28189 ts_tablet_manager.cc:1397] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.004s
I20260805 22:54:05.761600 28190 tablet_bootstrap.cc:492] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: No bootstrap required, opened a new log
I20260805 22:54:05.762060 28190 ts_tablet_manager.cc:1397] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.007s
I20260805 22:54:05.766247 28194 tablet_bootstrap.cc:654] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:05.767705 28194 log.cc:824] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:05.771445 28189 raft_consensus.cc:348] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:05.772296 28189 raft_consensus.cc:374] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:05.772488 28189 raft_consensus.cc:729] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6371f79199478a9cbfe18b0cab38fa, State: Initialized, Role: FOLLOWER
I20260805 22:54:05.773564 28189 consensus_queue.cc:260] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:05.776966 28190 raft_consensus.cc:348] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:05.777684 28190 raft_consensus.cc:374] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:05.777894 28190 raft_consensus.cc:729] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7448d4bc62f54c8b86cc1031f3330ac7, State: Initialized, Role: FOLLOWER
I20260805 22:54:05.778963 28190 consensus_queue.cc:260] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:05.780424 28194 tablet_bootstrap.cc:492] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: No bootstrap required, opened a new log
I20260805 22:54:05.780825 28194 ts_tablet_manager.cc:1397] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.009s
I20260805 22:54:05.782253 28189 ts_tablet_manager.cc:1428] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Time spent starting tablet: real 0.023s user 0.014s sys 0.006s
I20260805 22:54:05.785387 28167 heartbeater.cc:503] Master 127.20.34.126:45357 was elected leader, sending a full tablet report...
I20260805 22:54:05.786156 28190 ts_tablet_manager.cc:1428] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Time spent starting tablet: real 0.024s user 0.014s sys 0.008s
I20260805 22:54:05.793368 28194 raft_consensus.cc:348] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:05.793839 28194 raft_consensus.cc:374] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:05.793987 28194 raft_consensus.cc:729] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2c67c7861d4a428135f7ed9149f9e8, State: Initialized, Role: FOLLOWER
I20260805 22:54:05.794775 28194 consensus_queue.cc:260] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:05.796211 27962 heartbeater.cc:503] Master 127.20.34.126:45357 was elected leader, sending a full tablet report...
I20260805 22:54:05.796597 28194 ts_tablet_manager.cc:1428] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Time spent starting tablet: real 0.016s user 0.013s sys 0.000s
W20260805 22:54:05.858665 28168 tablet.cc:2369] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:54:05.867180 27964 tablet.cc:2369] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:54:05.892426 27768 tablet.cc:2369] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:54:06.058524 28202 raft_consensus.cc:482] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:06.058883 28202 raft_consensus.cc:504] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:06.060757 28202 leader_election.cc:288] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7448d4bc62f54c8b86cc1031f3330ac7 (127.20.34.67:34567), 4f6371f79199478a9cbfe18b0cab38fa (127.20.34.65:34525)
I20260805 22:54:06.064762 28185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:06.061432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:54505 (local address 127.20.34.67:34567)
0805 22:54:06.061636 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:06.061643 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:06.062294 (+ 651us) server_negotiation.cc:407] Connection header received
0805 22:54:06.062468 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:06.062473 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:06.062532 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:06.062641 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:06.063968 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:06.063975 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:06.063980 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:06.064001 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:06.064043 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:06.064060 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:06.064280 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:06.064442 (+ 162us) server_negotiation.cc:299] Negotiation successful
0805 22:54:06.064500 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:54:06.064762 28188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:06.061273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:47127 (local address 127.20.34.65:34525)
0805 22:54:06.061482 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:06.061488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:06.062234 (+ 746us) server_negotiation.cc:407] Connection header received
0805 22:54:06.062449 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:06.062454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:06.062524 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:06.062642 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:06.063969 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:06.063975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:06.063980 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:06.064001 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:06.064043 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:06.064136 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:06.064280 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:06.064411 (+ 131us) server_negotiation.cc:299] Negotiation successful
0805 22:54:06.064483 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 22:54:06.065122 28205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:06.061055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34525 (local address 127.20.34.66:47127)
0805 22:54:06.062073 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:06.062118 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:06.062279 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:06.062696 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:06.062702 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:06.062729 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:06.063715 (+ 986us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:54:06.063718 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:06.063738 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:54:06.063790 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:06.064282 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:06.064287 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:06.064291 (+ 4us) client_negotiation.cc:769] Sending connection context
0805 22:54:06.064541 (+ 250us) client_negotiation.cc:240] Negotiation successful
0805 22:54:06.064578 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"thread_start_us":768,"threads_started":1}
I20260805 22:54:06.065397 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:06.061177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34567 (local address 127.20.34.66:54505)
0805 22:54:06.062175 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:06.062193 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:06.062346 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:06.062696 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:06.062702 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:06.062729 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:06.063715 (+ 986us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:54:06.063718 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:06.063738 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:54:06.063790 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:06.064252 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:06.064259 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:06.064266 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 22:54:06.064485 (+ 219us) client_negotiation.cc:240] Negotiation successful
0805 22:54:06.064556 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":883,"spinlock_wait_cycles":25344,"thread_start_us":483,"threads_started":1}
I20260805 22:54:06.066509 28090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b92e676d6fc746e48cb61224c2eb3bce" candidate_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" is_pre_election: true
I20260805 22:54:06.066511 27701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b92e676d6fc746e48cb61224c2eb3bce" candidate_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6371f79199478a9cbfe18b0cab38fa" is_pre_election: true
I20260805 22:54:06.067131 27701 raft_consensus.cc:2454] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2c67c7861d4a428135f7ed9149f9e8 in term 0.
I20260805 22:54:06.067131 28090 raft_consensus.cc:2454] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e2c67c7861d4a428135f7ed9149f9e8 in term 0.
I20260805 22:54:06.067818 27797 leader_election.cc:302] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6371f79199478a9cbfe18b0cab38fa, 9e2c67c7861d4a428135f7ed9149f9e8; no voters:
I20260805 22:54:06.068238 28202 raft_consensus.cc:2781] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:06.068428 28202 raft_consensus.cc:482] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:06.068572 28202 raft_consensus.cc:3037] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:06.070917 28202 raft_consensus.cc:504] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:06.071635 28202 leader_election.cc:288] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [CANDIDATE]: Term 1 election: Requested vote from peers 7448d4bc62f54c8b86cc1031f3330ac7 (127.20.34.67:34567), 4f6371f79199478a9cbfe18b0cab38fa (127.20.34.65:34525)
I20260805 22:54:06.072096 28090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b92e676d6fc746e48cb61224c2eb3bce" candidate_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7448d4bc62f54c8b86cc1031f3330ac7"
I20260805 22:54:06.072309 27701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b92e676d6fc746e48cb61224c2eb3bce" candidate_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6371f79199478a9cbfe18b0cab38fa"
I20260805 22:54:06.072412 28090 raft_consensus.cc:3037] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:06.072572 27701 raft_consensus.cc:3037] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:06.074769 28090 raft_consensus.cc:2454] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2c67c7861d4a428135f7ed9149f9e8 in term 1.
I20260805 22:54:06.074880 27701 raft_consensus.cc:2454] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e2c67c7861d4a428135f7ed9149f9e8 in term 1.
I20260805 22:54:06.075261 27796 leader_election.cc:302] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7448d4bc62f54c8b86cc1031f3330ac7, 9e2c67c7861d4a428135f7ed9149f9e8; no voters:
I20260805 22:54:06.075629 28202 raft_consensus.cc:2781] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:06.076097 28202 raft_consensus.cc:686] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 1 LEADER]: Becoming Leader. State: Replica: 9e2c67c7861d4a428135f7ed9149f9e8, State: Running, Role: LEADER
I20260805 22:54:06.076622 28202 consensus_queue.cc:237] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } }
I20260805 22:54:06.081924 27496 catalog_manager.cc:5495] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e2c67c7861d4a428135f7ed9149f9e8 (127.20.34.66). New cstate: current_term: 1 leader_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e2c67c7861d4a428135f7ed9149f9e8" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 35387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 } health_report { overall_health: UNKNOWN } } }
I20260805 22:54:06.164785 28183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:06.161923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55280 (local address 127.20.34.66:35387)
0805 22:54:06.162104 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:06.162109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:06.162738 (+ 629us) server_negotiation.cc:407] Connection header received
0805 22:54:06.162931 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:06.162935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:06.163036 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:06.163125 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:06.164105 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:06.164109 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:06.164112 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:06.164127 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:06.164217 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:06.164231 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:06.164324 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:06.164504 (+ 180us) server_negotiation.cc:299] Negotiation successful
0805 22:54:06.164557 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 22:54:06.173718 28090 raft_consensus.cc:1261] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 1 FOLLOWER]: Refusing update from remote peer 9e2c67c7861d4a428135f7ed9149f9e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:06.173717 27701 raft_consensus.cc:1261] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 1 FOLLOWER]: Refusing update from remote peer 9e2c67c7861d4a428135f7ed9149f9e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:06.174753 28207 consensus_queue.cc:1035] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6371f79199478a9cbfe18b0cab38fa" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:06.175153 28202 consensus_queue.cc:1035] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7448d4bc62f54c8b86cc1031f3330ac7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:06.187252 28211 mvcc.cc:205] Tried to move back new op lower bound from 7315334947516686336 to 7315334947134554112. Current Snapshot: MvccSnapshot[applied={T|T < 7315334947516686336}]
I20260805 22:54:06.188712 28212 mvcc.cc:205] Tried to move back new op lower bound from 7315334947516686336 to 7315334947134554112. Current Snapshot: MvccSnapshot[applied={T|T < 7315334947516686336}]
I20260805 22:54:06.201850 27496 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40666:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:06.202219 27496 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40666:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:06.206154 27496 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8cfa5f1f4c994c54a62a8808c9b53174: Sending DeleteTablet for 3 replicas of tablet b92e676d6fc746e48cb61224c2eb3bce
I20260805 22:54:06.207481 27672 tablet_service.cc:1514] Processing DeleteTablet for tablet b92e676d6fc746e48cb61224c2eb3bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:06 UTC) from {username='slave'} at 127.0.0.1:42454
I20260805 22:54:06.207487 27869 tablet_service.cc:1514] Processing DeleteTablet for tablet b92e676d6fc746e48cb61224c2eb3bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:06 UTC) from {username='slave'} at 127.0.0.1:55266
I20260805 22:54:06.208353 28063 tablet_service.cc:1514] Processing DeleteTablet for tablet b92e676d6fc746e48cb61224c2eb3bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:06 UTC) from {username='slave'} at 127.0.0.1:37044
I20260805 22:54:06.209411 28228 tablet_replica.cc:330] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: stopping tablet replica
I20260805 22:54:06.209990 28228 raft_consensus.cc:2229] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:06.210640 28228 raft_consensus.cc:2258] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:06.210922 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 27578
I20260805 22:54:06.213243 28228 ts_tablet_manager.cc:1905] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:06.221434 28228 ts_tablet_manager.cc:1918] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:06.221746 28228 log.cc:1196] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/b92e676d6fc746e48cb61224c2eb3bce
I20260805 22:54:06.222429 28228 ts_tablet_manager.cc:1939] T b92e676d6fc746e48cb61224c2eb3bce P 7448d4bc62f54c8b86cc1031f3330ac7: Deleting consensus metadata
I20260805 22:54:06.223104 28224 tablet_replica.cc:330] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: stopping tablet replica
I20260805 22:54:06.224421 28226 tablet_replica.cc:330] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: stopping tablet replica
I20260805 22:54:06.224756 27477 catalog_manager.cc:4841] TS 7448d4bc62f54c8b86cc1031f3330ac7 (127.20.34.67:34567): tablet b92e676d6fc746e48cb61224c2eb3bce (table test-table [id=79498f3de81f49e9a1025a532dd07d03]) successfully deleted
I20260805 22:54:06.224910 28226 raft_consensus.cc:2229] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:06.225574 28226 raft_consensus.cc:2258] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:06.226274 28224 raft_consensus.cc:2229] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:54:06.227155 28224 raft_consensus.cc:2258] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:06.229807 28224 ts_tablet_manager.cc:1905] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:06.229812 28226 ts_tablet_manager.cc:1905] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:06.235399 28226 ts_tablet_manager.cc:1918] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:06.235610 28226 log.cc:1196] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/b92e676d6fc746e48cb61224c2eb3bce
I20260805 22:54:06.236285 28226 ts_tablet_manager.cc:1939] T b92e676d6fc746e48cb61224c2eb3bce P 4f6371f79199478a9cbfe18b0cab38fa: Deleting consensus metadata
I20260805 22:54:06.237183 28188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:06.212892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42464 (local address 127.20.34.65:34525)
0805 22:54:06.213128 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:06.213137 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:06.230137 (+ 17000us) server_negotiation.cc:407] Connection header received
0805 22:54:06.230681 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:06.230687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:06.230778 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:06.230876 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:06.236247 (+ 5371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:06.236255 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:06.236262 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:06.236293 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:06.236334 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:06.236353 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:06.236478 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:06.236805 (+ 327us) server_negotiation.cc:299] Negotiation successful
0805 22:54:06.236891 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:54:06.238320 28224 ts_tablet_manager.cc:1918] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:06.238318 27479 catalog_manager.cc:4841] TS 4f6371f79199478a9cbfe18b0cab38fa (127.20.34.65:34525): tablet b92e676d6fc746e48cb61224c2eb3bce (table test-table [id=79498f3de81f49e9a1025a532dd07d03]) successfully deleted
I20260805 22:54:06.238560 28224 log.cc:1196] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/b92e676d6fc746e48cb61224c2eb3bce
I20260805 22:54:06.239207 28224 ts_tablet_manager.cc:1939] T b92e676d6fc746e48cb61224c2eb3bce P 9e2c67c7861d4a428135f7ed9149f9e8: Deleting consensus metadata
I20260805 22:54:06.239447 27759 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:06.241359 27481 catalog_manager.cc:4841] TS 9e2c67c7861d4a428135f7ed9149f9e8 (127.20.34.66:35387): tablet b92e676d6fc746e48cb61224c2eb3bce (table test-table [id=79498f3de81f49e9a1025a532dd07d03]) successfully deleted
I20260805 22:54:06.350152 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 27578
I20260805 22:54:06.381381 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 27773
I20260805 22:54:06.385047 28183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:06.382504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55292 (local address 127.20.34.66:35387)
0805 22:54:06.382734 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:06.382740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:06.382762 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:54:06.382854 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:06.382859 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:06.382925 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:06.383041 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:06.384277 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:06.384282 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:06.384289 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:06.384307 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:06.384346 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:06.384359 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:06.384473 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:06.384637 (+ 164us) server_negotiation.cc:299] Negotiation successful
0805 22:54:06.384693 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:54:06.385788 27956 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:06.504570 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 27773
I20260805 22:54:06.535193 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 27969
I20260805 22:54:06.538347 28185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:06.535987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37050 (local address 127.20.34.67:34567)
0805 22:54:06.536360 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:06.536364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:06.536385 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:54:06.536444 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:06.536448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:06.536541 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:06.536629 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:06.537654 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:06.537659 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:06.537662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:06.537679 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:06.537713 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:06.537726 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:06.537847 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:06.537947 (+ 100us) server_negotiation.cc:299] Negotiation successful
0805 22:54:06.537999 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260805 22:54:06.539036 28158 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:06.630265 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 27969
I20260805 22:54:06.657320 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 27450
I20260805 22:54:06.658640 27539 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:06.771183 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 27450
2026-08-05T22:54:06Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3303 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260805 22:54:06.825484 20617 mini_oidc.cc:152] Starting JWKS server
I20260805 22:54:06.829985 20617 webserver.cc:460] Webserver started at https://127.0.0.1:40361/ using document root <none> and password file <none>
I20260805 22:54:06.830399 20617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:54:06.831092 20617 webserver.cc:460] Webserver started at http://127.0.0.1:43115/ using document root <none> and password file <none>
2026-08-05T22:54:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:06Z Disabled control of system clock
I20260805 22:54:06.872131 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:38145
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:33033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:38145
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40361/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/testchainca.cert with env {}
W20260805 22:54:07.228582 28244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:07.228983 28244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:07.229146 28244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:07.236994 28244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:07.237156 28244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:07.237259 28244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:07.237371 28244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:07.237457 28244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:54:07.237553 28244 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:54:07.237633 28244 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40361/jwks.json
I20260805 22:54:07.248461 28244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:38145
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:38145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40361/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:07.249923 28244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:07.251308 28244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:07.263653 28254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:07.263674 28257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:07.263720 28255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:07.264854 28244 server_base.cc:1034] running on GCE node
I20260805 22:54:07.265789 28244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:07.267314 28244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:07.268538 28244 hybrid_clock.cc:648] HybridClock initialized: now 1785970447268478 us; error 43 us; skew 500 ppm
I20260805 22:54:07.268920 28244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:07.271483 28244 webserver.cc:460] Webserver started at http://127.20.34.126:46419/ using document root <none> and password file <none>
I20260805 22:54:07.272343 28244 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:07.272456 28244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:07.272753 28244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:07.275947 28244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "a963fadf1a0d43d8a34d9978c7bee223"
format_stamp: "Formatted at 2026-08-05 22:54:07 on dist-test-slave-gmjp"
server_key: "d579aade0efcd83441282a6d7270eb51"
server_key_iv: "a6a90668a51e71526c04c95096657a3d"
server_key_version: "encryptionkey@0"
I20260805 22:54:07.276899 28244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "a963fadf1a0d43d8a34d9978c7bee223"
format_stamp: "Formatted at 2026-08-05 22:54:07 on dist-test-slave-gmjp"
server_key: "d579aade0efcd83441282a6d7270eb51"
server_key_iv: "a6a90668a51e71526c04c95096657a3d"
server_key_version: "encryptionkey@0"
I20260805 22:54:07.282745 28244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:54:07.286729 28272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:07.288470 28244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:07.288653 28244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "a963fadf1a0d43d8a34d9978c7bee223"
format_stamp: "Formatted at 2026-08-05 22:54:07 on dist-test-slave-gmjp"
server_key: "d579aade0efcd83441282a6d7270eb51"
server_key_iv: "a6a90668a51e71526c04c95096657a3d"
server_key_version: "encryptionkey@0"
I20260805 22:54:07.288870 28244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:07.305310 28244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:07.306201 28244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:07.306499 28244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:07.326840 28244 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:38145
I20260805 22:54:07.326867 28347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:38145 every 8 connection(s)
I20260805 22:54:07.328423 28244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:07.329545 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 28244
I20260805 22:54:07.329835 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:07.330576 20617 external_mini_cluster.cc:1428] Setting key ff5380f424d6f21e6b020047585ac17b
I20260805 22:54:07.334120 28348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:07.347499 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:07.332466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43672 (local address 127.20.34.126:38145)
0805 22:54:07.333597 (+ 1131us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:07.333615 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:07.333670 (+ 55us) server_negotiation.cc:407] Connection header received
0805 22:54:07.336046 (+ 2376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:07.336078 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:07.336715 (+ 637us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:07.337185 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:07.337783 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:07.339936 (+ 2153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:07.341465 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:07.342527 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:07.342743 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:07.344121 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:07.344134 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:07.344188 (+ 54us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:07.345011 (+ 823us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:07.345118 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:07.345147 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:07.345279 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:07.345572 (+ 293us) server_negotiation.cc:299] Negotiation successful
0805 22:54:07.345990 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":355,"threads_started":1}
I20260805 22:54:07.349274 28348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223: Bootstrap starting.
I20260805 22:54:07.352272 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:54:07.353288 28348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:07.354382 28348 log.cc:824] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:07.358016 28348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223: No bootstrap required, opened a new log
I20260805 22:54:07.366183 28348 raft_consensus.cc:348] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a963fadf1a0d43d8a34d9978c7bee223" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38145 } }
I20260805 22:54:07.366551 28348 raft_consensus.cc:374] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:07.366628 28348 raft_consensus.cc:729] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a963fadf1a0d43d8a34d9978c7bee223, State: Initialized, Role: FOLLOWER
I20260805 22:54:07.367249 28348 consensus_queue.cc:260] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a963fadf1a0d43d8a34d9978c7bee223" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38145 } }
I20260805 22:54:07.367513 28348 raft_consensus.cc:388] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:07.367664 28348 raft_consensus.cc:482] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:07.367873 28348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:07.370183 28348 raft_consensus.cc:504] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a963fadf1a0d43d8a34d9978c7bee223" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38145 } }
I20260805 22:54:07.370733 28348 leader_election.cc:302] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a963fadf1a0d43d8a34d9978c7bee223; no voters:
I20260805 22:54:07.371366 28348 leader_election.cc:288] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:07.371577 28355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:07.372877 28355 raft_consensus.cc:686] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [term 1 LEADER]: Becoming Leader. State: Replica: a963fadf1a0d43d8a34d9978c7bee223, State: Running, Role: LEADER
I20260805 22:54:07.373422 28355 consensus_queue.cc:237] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a963fadf1a0d43d8a34d9978c7bee223" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38145 } }
I20260805 22:54:07.373859 28348 sys_catalog.cc:564] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:07.376245 28357 sys_catalog.cc:455] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a963fadf1a0d43d8a34d9978c7bee223. Latest consensus state: current_term: 1 leader_uuid: "a963fadf1a0d43d8a34d9978c7bee223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a963fadf1a0d43d8a34d9978c7bee223" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38145 } } }
I20260805 22:54:07.376852 28356 sys_catalog.cc:455] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a963fadf1a0d43d8a34d9978c7bee223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a963fadf1a0d43d8a34d9978c7bee223" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38145 } } }
I20260805 22:54:07.377321 28357 sys_catalog.cc:458] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:07.377358 28356 sys_catalog.cc:458] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:07.380177 28367 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:07.385571 28367 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:07.396138 28367 catalog_manager.cc:1347] Generated new cluster ID: 4ede9d609fd3469aa7f1414f982890ec
I20260805 22:54:07.396353 28367 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:07.420684 28367 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:07.422721 28367 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:07.441485 28367 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a963fadf1a0d43d8a34d9978c7bee223: Generated new TSK 0
I20260805 22:54:07.442466 28367 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260805 22:54:07.492244 28389 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260805 22:54:07.492516 28389 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 22:54:07.494831 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:07.463744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43680 (local address 127.20.34.126:38145)
0805 22:54:07.463988 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:07.463997 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:07.464512 (+ 515us) server_negotiation.cc:407] Connection header received
0805 22:54:07.464935 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:07.464939 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:07.465026 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:07.465175 (+ 149us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:54:07.465755 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:07.466532 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:07.467998 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:07.468556 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:07.468702 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:07.469316 (+ 614us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:54:07.493979 (+ 24663us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0805 22:54:07.494457 (+ 478us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43680: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":67}
W20260805 22:54:07.494995 28353 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43680: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260805 22:54:07.497031 28388 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:07.463687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:38145 (local address 127.0.0.1:43680)
0805 22:54:07.464393 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:07.464410 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:07.464621 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:07.465211 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:07.465217 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:07.465230 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:54:07.465594 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:07.465603 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:07.466690 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:07.466703 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:07.467841 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:07.467854 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:07.468789 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:07.468801 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:07.468932 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:07.468995 (+ 63us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:54:07.494384 (+ 25389us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0805 22:54:07.494844 (+ 460us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.34.126:38145: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":347,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.34.126:38145: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40361/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260805 22:54:07.499423 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 28244
I20260805 22:54:07.500751 28341 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:07.602334 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 28244
2026-08-05T22:54:07Z chronyd exiting
I20260805 22:54:07.663820 20617 test_util.cc:175] -----------------------------------------------
I20260805 22:54:07.664034 20617 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970399628623-20617-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (845 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260805 22:54:07.668068 20617 mini_oidc.cc:152] Starting JWKS server
I20260805 22:54:07.669996 20617 webserver.cc:460] Webserver started at https://127.0.0.1:42807/ using document root <none> and password file <none>
I20260805 22:54:07.670265 20617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:54:07.670984 20617 webserver.cc:460] Webserver started at http://127.0.0.1:43077/ using document root <none> and password file <none>
2026-08-05T22:54:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:07Z Disabled control of system clock
I20260805 22:54:07.713472 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:44623
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:41083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:44623
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42807/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/testchainca.cert with env {}
W20260805 22:54:08.071787 28400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:08.072225 28400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:08.072400 28400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:08.080080 28400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:08.080302 28400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:08.080389 28400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:08.080513 28400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:08.080595 28400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:54:08.080688 28400 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:54:08.080767 28400 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42807/jwks.json
I20260805 22:54:08.091571 28400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:44623
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:44623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42807/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:08.093215 28400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:08.094668 28400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:08.108227 28410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:08.108278 28413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:08.108243 28417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:08.109360 28400 server_base.cc:1034] running on GCE node
I20260805 22:54:08.110347 28400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:08.111905 28400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:08.113112 28400 hybrid_clock.cc:648] HybridClock initialized: now 1785970448113053 us; error 62 us; skew 500 ppm
I20260805 22:54:08.113509 28400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:08.116039 28400 webserver.cc:460] Webserver started at http://127.20.34.126:37839/ using document root <none> and password file <none>
I20260805 22:54:08.116848 28400 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:08.116982 28400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:08.117341 28400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:08.120587 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "7a2d07beab5243d894b3be8098487a65"
format_stamp: "Formatted at 2026-08-05 22:54:08 on dist-test-slave-gmjp"
server_key: "57eea14a04e9072614cf27f5b3c0e282"
server_key_iv: "529c1b03fd884d94db0c9cd70928faee"
server_key_version: "encryptionkey@0"
I20260805 22:54:08.121516 28400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "7a2d07beab5243d894b3be8098487a65"
format_stamp: "Formatted at 2026-08-05 22:54:08 on dist-test-slave-gmjp"
server_key: "57eea14a04e9072614cf27f5b3c0e282"
server_key_iv: "529c1b03fd884d94db0c9cd70928faee"
server_key_version: "encryptionkey@0"
I20260805 22:54:08.127815 28400 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 22:54:08.132006 28425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:08.133584 28400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:08.133841 28400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "7a2d07beab5243d894b3be8098487a65"
format_stamp: "Formatted at 2026-08-05 22:54:08 on dist-test-slave-gmjp"
server_key: "57eea14a04e9072614cf27f5b3c0e282"
server_key_iv: "529c1b03fd884d94db0c9cd70928faee"
server_key_version: "encryptionkey@0"
I20260805 22:54:08.134097 28400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:08.156905 28400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:08.157879 28400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:08.158222 28400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:08.177970 28400 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:44623
I20260805 22:54:08.177990 28505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:44623 every 8 connection(s)
I20260805 22:54:08.179478 28400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:08.181836 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 28400
I20260805 22:54:08.182055 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:08.182735 20617 external_mini_cluster.cc:1428] Setting key 7dc48b602ec32d0c3ee50ddf99eac8a8
I20260805 22:54:08.183815 28506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:08.196691 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:08.184737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54910 (local address 127.20.34.126:44623)
0805 22:54:08.185743 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:08.185764 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:08.185809 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:54:08.187431 (+ 1622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:08.187455 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:08.187942 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:08.188459 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:08.189044 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:08.190473 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:08.191854 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:08.192631 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:08.192907 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:08.194186 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:08.194194 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:08.194210 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:08.194837 (+ 627us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:08.194924 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:08.194945 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:08.195074 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:08.195320 (+ 246us) server_negotiation.cc:299] Negotiation successful
0805 22:54:08.195650 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":375,"threads_started":1}
I20260805 22:54:08.196854 28506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65: Bootstrap starting.
I20260805 22:54:08.200948 28506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:08.200974 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:54:08.201979 28506 log.cc:824] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:08.205442 28506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65: No bootstrap required, opened a new log
I20260805 22:54:08.213691 28506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2d07beab5243d894b3be8098487a65" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44623 } }
I20260805 22:54:08.214221 28506 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:08.214361 28506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2d07beab5243d894b3be8098487a65, State: Initialized, Role: FOLLOWER
I20260805 22:54:08.214978 28506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2d07beab5243d894b3be8098487a65" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44623 } }
I20260805 22:54:08.215238 28506 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:08.215402 28506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:08.215598 28506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:08.217962 28506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2d07beab5243d894b3be8098487a65" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44623 } }
I20260805 22:54:08.218637 28506 leader_election.cc:302] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a2d07beab5243d894b3be8098487a65; no voters:
I20260805 22:54:08.219303 28506 leader_election.cc:288] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:08.219480 28512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:08.220319 28512 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [term 1 LEADER]: Becoming Leader. State: Replica: 7a2d07beab5243d894b3be8098487a65, State: Running, Role: LEADER
I20260805 22:54:08.220933 28512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2d07beab5243d894b3be8098487a65" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44623 } }
I20260805 22:54:08.221616 28506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:08.223969 28513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a2d07beab5243d894b3be8098487a65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2d07beab5243d894b3be8098487a65" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44623 } } }
I20260805 22:54:08.224462 28513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:08.224339 28514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a2d07beab5243d894b3be8098487a65. Latest consensus state: current_term: 1 leader_uuid: "7a2d07beab5243d894b3be8098487a65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2d07beab5243d894b3be8098487a65" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44623 } } }
I20260805 22:54:08.224661 28514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:08.227456 28522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:08.233283 28522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:08.242452 28522 catalog_manager.cc:1347] Generated new cluster ID: 9009283c717a40d39651beb76145884c
I20260805 22:54:08.242586 28522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:08.267835 28522 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:08.269559 28522 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:08.277542 28522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a2d07beab5243d894b3be8098487a65: Generated new TSK 0
I20260805 22:54:08.278515 28522 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260805 22:54:08.322376 28542 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260805 22:54:08.322535 28542 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 22:54:08.323765 28510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:08.294579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54914 (local address 127.20.34.126:44623)
0805 22:54:08.294892 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:08.294901 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:08.295323 (+ 422us) server_negotiation.cc:407] Connection header received
0805 22:54:08.295642 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:08.295647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:08.295732 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:08.295951 (+ 219us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:54:08.296552 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:08.297321 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:08.298770 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:08.299244 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:08.299408 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:08.299966 (+ 558us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:54:08.322959 (+ 22993us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42807/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0805 22:54:08.323418 (+ 459us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54914: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42807/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":65}
W20260805 22:54:08.323942 28510 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54914: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42807/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260805 22:54:08.324023 28541 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:08.294495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:44623 (local address 127.0.0.1:54914)
0805 22:54:08.295174 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:08.295196 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:08.295425 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:08.295954 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:08.295960 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:08.295974 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:54:08.296362 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:08.296374 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:08.297488 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:08.297495 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:08.298600 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:08.298613 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:08.299439 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:08.299445 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:08.299611 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:08.299650 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:54:08.323251 (+ 23601us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42807/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0805 22:54:08.323555 (+ 304us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.34.126:44623: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42807/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":360,"threads_started":1}
I20260805 22:54:08.326133 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 28400
I20260805 22:54:08.327368 28495 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:08.426652 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 28400
2026-08-05T22:54:08Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (825 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260805 22:54:08.493711 20617 mini_oidc.cc:152] Starting JWKS server
I20260805 22:54:08.495775 20617 webserver.cc:460] Webserver started at https://127.0.0.1:37219/ using document root <none> and password file <none>
I20260805 22:54:08.496068 20617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 22:54:08.496778 20617 webserver.cc:460] Webserver started at http://127.0.0.1:36523/ using document root <none> and password file <none>
2026-08-05T22:54:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:08Z Disabled control of system clock
I20260805 22:54:08.537580 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39659
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:34359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:39659
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37219/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260805 22:54:08.892731 28553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:08.893158 28553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:08.893323 28553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:08.901144 28553 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:08.901320 28553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:08.901424 28553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:08.901536 28553 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:08.901626 28553 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:54:08.901721 28553 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:54:08.901804 28553 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37219/jwks.json
I20260805 22:54:08.911450 28553 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:39659
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37219/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:08.913044 28553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:08.914976 28553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:08.927944 28564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:08.927922 28561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:08.928314 28562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:08.929443 28553 server_base.cc:1034] running on GCE node
I20260805 22:54:08.930299 28553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:08.932010 28553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:08.933261 28553 hybrid_clock.cc:648] HybridClock initialized: now 1785970448933229 us; error 63 us; skew 500 ppm
I20260805 22:54:08.933647 28553 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:08.936079 28553 webserver.cc:460] Webserver started at http://127.20.34.126:35905/ using document root <none> and password file <none>
I20260805 22:54:08.936939 28553 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:08.937083 28553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:08.937459 28553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:08.940886 28553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "9da853de9d514501af94724396fdb7cc"
format_stamp: "Formatted at 2026-08-05 22:54:08 on dist-test-slave-gmjp"
server_key: "77e33bb4efff5f23bd20757313a7e325"
server_key_iv: "c7c6a21f1c6e42463f90398322ae8a8b"
server_key_version: "encryptionkey@0"
I20260805 22:54:08.941895 28553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "9da853de9d514501af94724396fdb7cc"
format_stamp: "Formatted at 2026-08-05 22:54:08 on dist-test-slave-gmjp"
server_key: "77e33bb4efff5f23bd20757313a7e325"
server_key_iv: "c7c6a21f1c6e42463f90398322ae8a8b"
server_key_version: "encryptionkey@0"
I20260805 22:54:08.947750 28553 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:54:08.951766 28577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:08.953413 28553 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:08.953629 28553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "9da853de9d514501af94724396fdb7cc"
format_stamp: "Formatted at 2026-08-05 22:54:08 on dist-test-slave-gmjp"
server_key: "77e33bb4efff5f23bd20757313a7e325"
server_key_iv: "c7c6a21f1c6e42463f90398322ae8a8b"
server_key_version: "encryptionkey@0"
I20260805 22:54:08.953918 28553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:08.980293 28553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:08.981269 28553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:08.981630 28553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:09.002593 28553 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:39659
I20260805 22:54:09.002625 28649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:39659 every 8 connection(s)
I20260805 22:54:09.004223 28553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:09.005743 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 28553
I20260805 22:54:09.006011 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:09.006683 20617 external_mini_cluster.cc:1428] Setting key 5dc9119ec5d57509970a5f59398dc90f
I20260805 22:54:09.009548 28650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:09.024668 28656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:09.008950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47942 (local address 127.20.34.126:39659)
0805 22:54:09.010140 (+ 1190us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:09.010157 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:09.010214 (+ 57us) server_negotiation.cc:407] Connection header received
0805 22:54:09.012653 (+ 2439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:09.012685 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:09.013375 (+ 690us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:09.013897 (+ 522us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:09.014498 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.016685 (+ 2187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.018392 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.019557 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.019765 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:09.021287 (+ 1522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:09.021298 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:09.021321 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:09.022181 (+ 860us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:09.022291 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:09.022327 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:09.022477 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:09.022791 (+ 314us) server_negotiation.cc:299] Negotiation successful
0805 22:54:09.023206 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":390,"threads_started":1}
I20260805 22:54:09.025447 28650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc: Bootstrap starting.
I20260805 22:54:09.029124 28650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:09.029186 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:54:09.030213 28650 log.cc:824] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:09.033496 28650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc: No bootstrap required, opened a new log
I20260805 22:54:09.041393 28650 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9da853de9d514501af94724396fdb7cc" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39659 } }
I20260805 22:54:09.041935 28650 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:09.042057 28650 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da853de9d514501af94724396fdb7cc, State: Initialized, Role: FOLLOWER
I20260805 22:54:09.042765 28650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9da853de9d514501af94724396fdb7cc" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39659 } }
I20260805 22:54:09.043030 28650 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:09.043193 28650 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:09.043390 28650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:09.045756 28650 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9da853de9d514501af94724396fdb7cc" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39659 } }
I20260805 22:54:09.046327 28650 leader_election.cc:302] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9da853de9d514501af94724396fdb7cc; no voters:
I20260805 22:54:09.047008 28650 leader_election.cc:288] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:09.047179 28659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:09.048449 28659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [term 1 LEADER]: Becoming Leader. State: Replica: 9da853de9d514501af94724396fdb7cc, State: Running, Role: LEADER
I20260805 22:54:09.049424 28650 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:09.049391 28659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9da853de9d514501af94724396fdb7cc" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39659 } }
I20260805 22:54:09.052790 28660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9da853de9d514501af94724396fdb7cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9da853de9d514501af94724396fdb7cc" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39659 } } }
I20260805 22:54:09.052744 28662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9da853de9d514501af94724396fdb7cc. Latest consensus state: current_term: 1 leader_uuid: "9da853de9d514501af94724396fdb7cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9da853de9d514501af94724396fdb7cc" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39659 } } }
I20260805 22:54:09.053227 28660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:09.053265 28662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:09.054605 28670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:09.060916 28670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:09.071350 28670 catalog_manager.cc:1347] Generated new cluster ID: b602599beb1a4b67932715899f21a8e7
I20260805 22:54:09.071496 28670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:09.090152 28670 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:09.092011 28670 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:09.106199 28670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9da853de9d514501af94724396fdb7cc: Generated new TSK 0
I20260805 22:54:09.107482 28670 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:54:09.140764 28656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:09.131129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47950 (local address 127.20.34.126:39659)
0805 22:54:09.131402 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:09.131409 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:09.131902 (+ 493us) server_negotiation.cc:407] Connection header received
0805 22:54:09.132233 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:09.132245 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:09.132358 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:09.132554 (+ 196us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:54:09.133085 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.134284 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.135908 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.136691 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.136827 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:09.137478 (+ 651us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:54:09.139992 (+ 2514us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37219/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0805 22:54:09.140420 (+ 428us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47950: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37219/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":90}
W20260805 22:54:09.140923 28656 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47950: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37219/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260805 22:54:09.142570 28696 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:09.130957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39659 (local address 127.0.0.1:47950)
0805 22:54:09.131746 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:09.131794 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:09.131985 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:09.132582 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:09.132586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:09.132596 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:54:09.132918 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:09.132928 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.134484 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.134490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:09.135731 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:09.135747 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.136929 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.136935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:09.137101 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:09.137140 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:54:09.140272 (+ 3132us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37219/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0805 22:54:09.142099 (+ 1827us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.34.126:39659: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37219/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":1463,"thread_start_us":469,"threads_started":1}
I20260805 22:54:09.144872 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 28553
I20260805 22:54:09.146379 28645 generic_service.cc:196] Checking for leaks (request via RPC)
E20260805 22:54:09.153357 28697 webserver.cc:533] Webserver: sslize failed:
E20260805 22:54:09.153494 28697 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 22:54:09.248618 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 28553
2026-08-05T22:54:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (820 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-05T22:54:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:09Z Disabled control of system clock
I20260805 22:54:09.357678 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:35807
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:39949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:35807
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/testchainca.cert with env {}
W20260805 22:54:09.717003 28704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:09.717372 28704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:09.717535 28704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:09.725311 28704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:09.725479 28704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:09.725569 28704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:09.725669 28704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:09.725752 28704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 22:54:09.725849 28704 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 22:54:09.725912 28704 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260805 22:54:09.736579 28704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:35807
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:35807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:09.738045 28704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:09.739499 28704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:09.752367 28710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:09.752456 28713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:09.752435 28711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:09.753610 28704 server_base.cc:1034] running on GCE node
I20260805 22:54:09.754532 28704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:09.756111 28704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:09.757377 28704 hybrid_clock.cc:648] HybridClock initialized: now 1785970449757329 us; error 40 us; skew 500 ppm
I20260805 22:54:09.757759 28704 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:09.760319 28704 webserver.cc:460] Webserver started at http://127.20.34.126:38361/ using document root <none> and password file <none>
I20260805 22:54:09.761204 28704 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:09.761349 28704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:09.761705 28704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:09.764956 28704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "2ccc0d0454094d608579adee83343be4"
format_stamp: "Formatted at 2026-08-05 22:54:09 on dist-test-slave-gmjp"
server_key: "96c32430d3c321fe2fea7ac07b1fd8f2"
server_key_iv: "772cc16a00bf0c584d16c0decc678eb1"
server_key_version: "encryptionkey@0"
I20260805 22:54:09.765887 28704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "2ccc0d0454094d608579adee83343be4"
format_stamp: "Formatted at 2026-08-05 22:54:09 on dist-test-slave-gmjp"
server_key: "96c32430d3c321fe2fea7ac07b1fd8f2"
server_key_iv: "772cc16a00bf0c584d16c0decc678eb1"
server_key_version: "encryptionkey@0"
I20260805 22:54:09.771585 28704 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:54:09.775628 28723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:09.777310 28704 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:09.777546 28704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "2ccc0d0454094d608579adee83343be4"
format_stamp: "Formatted at 2026-08-05 22:54:09 on dist-test-slave-gmjp"
server_key: "96c32430d3c321fe2fea7ac07b1fd8f2"
server_key_iv: "772cc16a00bf0c584d16c0decc678eb1"
server_key_version: "encryptionkey@0"
I20260805 22:54:09.777805 28704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:09.802515 28704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:09.803427 28704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:09.803740 28704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:09.823524 28704 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:35807
I20260805 22:54:09.823544 28800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:35807 every 8 connection(s)
I20260805 22:54:09.825034 28704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:09.826980 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 28704
I20260805 22:54:09.827214 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:09.828078 20617 external_mini_cluster.cc:1428] Setting key bce90e1af9e90bd405c050ea5135f2d8
I20260805 22:54:09.829932 28801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:09.842717 28805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:09.830146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57460 (local address 127.20.34.126:35807)
0805 22:54:09.831120 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:09.831131 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:09.831172 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:54:09.832829 (+ 1657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:09.832858 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:09.833318 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:09.833752 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:09.834393 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.835723 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.837617 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.838310 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.838465 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:09.839963 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:09.839972 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:09.839989 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:09.840711 (+ 722us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:09.840806 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:09.840841 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:09.840955 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:09.841227 (+ 272us) server_negotiation.cc:299] Negotiation successful
0805 22:54:09.841643 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":351,"threads_started":1}
I20260805 22:54:09.844308 28801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4: Bootstrap starting.
I20260805 22:54:09.846987 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:54:09.847930 28801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:09.849077 28801 log.cc:824] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:09.852473 28801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4: No bootstrap required, opened a new log
I20260805 22:54:09.860085 28801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccc0d0454094d608579adee83343be4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35807 } }
I20260805 22:54:09.860576 28801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:09.860702 28801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ccc0d0454094d608579adee83343be4, State: Initialized, Role: FOLLOWER
I20260805 22:54:09.861295 28801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccc0d0454094d608579adee83343be4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35807 } }
I20260805 22:54:09.861516 28801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:09.861624 28801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:09.861755 28801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:09.863955 28801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccc0d0454094d608579adee83343be4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35807 } }
I20260805 22:54:09.864646 28801 leader_election.cc:302] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ccc0d0454094d608579adee83343be4; no voters:
I20260805 22:54:09.865245 28801 leader_election.cc:288] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:09.865438 28807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:09.866539 28807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [term 1 LEADER]: Becoming Leader. State: Replica: 2ccc0d0454094d608579adee83343be4, State: Running, Role: LEADER
I20260805 22:54:09.867136 28807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccc0d0454094d608579adee83343be4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35807 } }
I20260805 22:54:09.867395 28801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:09.874240 28808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ccc0d0454094d608579adee83343be4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccc0d0454094d608579adee83343be4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35807 } } }
I20260805 22:54:09.874284 28809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ccc0d0454094d608579adee83343be4. Latest consensus state: current_term: 1 leader_uuid: "2ccc0d0454094d608579adee83343be4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ccc0d0454094d608579adee83343be4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 35807 } } }
I20260805 22:54:09.874722 28808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:09.874781 28809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:09.876729 28819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:09.882609 28819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:09.891919 28819 catalog_manager.cc:1347] Generated new cluster ID: ba5bf0d02ceb4fccb5c985e9f0ecb2fa
I20260805 22:54:09.892052 28819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:09.909845 28819 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:09.911182 28819 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:09.921149 28819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ccc0d0454094d608579adee83343be4: Generated new TSK 0
I20260805 22:54:09.922302 28819 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:54:10.009191 28805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:09.939967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57468 (local address 127.20.34.126:35807)
0805 22:54:09.940235 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:09.940243 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:09.940628 (+ 385us) server_negotiation.cc:407] Connection header received
0805 22:54:09.940864 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:09.940875 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:09.940983 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:09.941180 (+ 197us) server_negotiation.cc:226] Negotiated authn=JWT
0805 22:54:09.941631 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.942812 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.944384 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.945076 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.945210 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:09.945968 (+ 758us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 22:54:10.008347 (+ 62379us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0805 22:54:10.008850 (+ 503us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57468: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":84}
W20260805 22:54:10.009325 28836 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:09.939834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:35807 (local address 127.0.0.1:57468)
0805 22:54:09.940511 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:09.940528 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:09.940659 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:09.941193 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:09.941197 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:09.941206 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0805 22:54:09.941463 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:09.941471 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.943024 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.943030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:09.944140 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:09.944208 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:09.945315 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:09.945326 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:09.945578 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:09.945638 (+ 60us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 22:54:10.008715 (+ 63077us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0805 22:54:10.008973 (+ 258us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.34.126:35807: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":357,"threads_started":1}
W20260805 22:54:10.009346 28805 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57468: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260805 22:54:10.010955 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 28704
I20260805 22:54:10.012445 28796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:10.115960 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 28704
2026-08-05T22:54:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (847 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (454 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (455 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:54:11 dist-test-slave-gmjp krb5kdc[28857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:54:11 dist-test-slave-gmjp krb5kdc[28857](info): set up 2 sockets
Aug 05 22:54:11 dist-test-slave-gmjp krb5kdc[28857](info): commencing operation
krb5kdc: starting...
W20260805 22:54:12.356360 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:54:12 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:54:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:54:12.652530 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42277
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:42277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:13.020219 28877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:13.020670 28877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:13.020855 28877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:13.028764 28877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:13.028903 28877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:13.028954 28877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:13.029006 28877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:13.029053 28877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:13.039809 28877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:42277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:13.041539 28877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:13.043045 28877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:13.056183 28886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:13.056282 28891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:13.056223 28887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:13.057381 28877 server_base.cc:1034] running on GCE node
I20260805 22:54:13.058403 28877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:13.060105 28877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:13.061463 28877 hybrid_clock.cc:648] HybridClock initialized: now 1785970453061414 us; error 46 us; skew 500 ppm
I20260805 22:54:13.061937 28877 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:13 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970453, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:13.068580 28877 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:54:13.070679 28877 webserver.cc:460] Webserver started at http://127.20.34.126:44815/ using document root <none> and password file <none>
I20260805 22:54:13.071725 28877 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:13.071947 28877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:13.072389 28877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:13.075920 28877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "909d4588b28546b5892d14b6b27ead7a"
format_stamp: "Formatted at 2026-08-05 22:54:13 on dist-test-slave-gmjp"
server_key: "6883657aa5e9b67e7477304fefc847a0"
server_key_iv: "3ab6bcabe9bef8fff85dabbc63ca816c"
server_key_version: "encryptionkey@0"
I20260805 22:54:13.076892 28877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "909d4588b28546b5892d14b6b27ead7a"
format_stamp: "Formatted at 2026-08-05 22:54:13 on dist-test-slave-gmjp"
server_key: "6883657aa5e9b67e7477304fefc847a0"
server_key_iv: "3ab6bcabe9bef8fff85dabbc63ca816c"
server_key_version: "encryptionkey@0"
I20260805 22:54:13.082896 28877 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 22:54:13.086730 28899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:13.088330 28877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 22:54:13.088546 28877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "909d4588b28546b5892d14b6b27ead7a"
format_stamp: "Formatted at 2026-08-05 22:54:13 on dist-test-slave-gmjp"
server_key: "6883657aa5e9b67e7477304fefc847a0"
server_key_iv: "3ab6bcabe9bef8fff85dabbc63ca816c"
server_key_version: "encryptionkey@0"
I20260805 22:54:13.088776 28877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:13.124255 28877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:13.129757 28877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:13.130184 28877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:13.151628 28877 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:42277
I20260805 22:54:13.151665 28972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:42277 every 8 connection(s)
I20260805 22:54:13.153294 28877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:13.154047 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 28877
I20260805 22:54:13.154345 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:13.155166 20617 external_mini_cluster.cc:1428] Setting key 42a94f508fc39c545e5d1a65c5e26d8a
I20260805 22:54:13.158967 28973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 22:54:13 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:13.175565 28973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a: Bootstrap starting.
I20260805 22:54:13.180727 28973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:13.182704 28973 log.cc:824] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:13.186554 28978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:13.157718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56702 (local address 127.20.34.126:42277)
0805 22:54:13.158729 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:13.158747 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:13.158806 (+ 59us) server_negotiation.cc:407] Connection header received
0805 22:54:13.161698 (+ 2892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:13.161736 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:13.162393 (+ 657us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:13.162966 (+ 573us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:13.164649 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:13.167150 (+ 2501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:13.168847 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:13.170098 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:13.170348 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:13.175011 (+ 4663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:13.175027 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:13.175055 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:13.175133 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:13.179874 (+ 4741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:13.180873 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:13.180885 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:13.180896 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:13.181170 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:13.181784 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:13.181794 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:13.181801 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:13.182876 (+ 1075us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:13.183282 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:13.184279 (+ 997us) server_negotiation.cc:299] Negotiation successful
0805 22:54:13.184911 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":403,"threads_started":1}
I20260805 22:54:13.187625 28973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a: No bootstrap required, opened a new log
I20260805 22:54:13.197252 28973 raft_consensus.cc:348] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909d4588b28546b5892d14b6b27ead7a" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42277 } }
I20260805 22:54:13.197719 28973 raft_consensus.cc:374] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:13.197860 28973 raft_consensus.cc:729] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 909d4588b28546b5892d14b6b27ead7a, State: Initialized, Role: FOLLOWER
I20260805 22:54:13.198570 28973 consensus_queue.cc:260] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909d4588b28546b5892d14b6b27ead7a" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42277 } }
I20260805 22:54:13.198841 28973 raft_consensus.cc:388] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:13.199012 28973 raft_consensus.cc:482] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:13.199199 28973 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:13.202135 28973 raft_consensus.cc:504] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909d4588b28546b5892d14b6b27ead7a" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42277 } }
I20260805 22:54:13.202735 28973 leader_election.cc:302] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 909d4588b28546b5892d14b6b27ead7a; no voters:
I20260805 22:54:13.203431 28973 leader_election.cc:288] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:13.203598 28982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:13.204840 28982 raft_consensus.cc:686] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [term 1 LEADER]: Becoming Leader. State: Replica: 909d4588b28546b5892d14b6b27ead7a, State: Running, Role: LEADER
I20260805 22:54:13.205401 28982 consensus_queue.cc:237] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909d4588b28546b5892d14b6b27ead7a" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42277 } }
I20260805 22:54:13.205832 28973 sys_catalog.cc:564] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:13.208448 28984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 909d4588b28546b5892d14b6b27ead7a. Latest consensus state: current_term: 1 leader_uuid: "909d4588b28546b5892d14b6b27ead7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909d4588b28546b5892d14b6b27ead7a" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42277 } } }
I20260805 22:54:13.208910 28984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:13.209522 28983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "909d4588b28546b5892d14b6b27ead7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909d4588b28546b5892d14b6b27ead7a" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42277 } } }
I20260805 22:54:13.209928 28983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:13.211956 28991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:13.217964 28991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:13.228426 28991 catalog_manager.cc:1347] Generated new cluster ID: d236b1d661ba44ba8bbb31248c55283d
I20260805 22:54:13.228592 28991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:13.242286 28991 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:13.243930 28991 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:13.252878 28991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 909d4588b28546b5892d14b6b27ead7a: Generated new TSK 0
I20260805 22:54:13.254011 28991 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:54:13.331795 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:42277
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:13.705569 29011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:13.705977 29011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:13.706152 29011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:13.714958 29011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:13.715123 29011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:13.715309 29011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:54:13.726034 29011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:42277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:13.727536 29011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:13.729084 29011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:13.742993 29019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:13.743032 29021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:13.743008 29017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:13.744261 29011 server_base.cc:1034] running on GCE node
I20260805 22:54:13.744936 29011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:13.745981 29011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:13.747191 29011 hybrid_clock.cc:648] HybridClock initialized: now 1785970453747144 us; error 35 us; skew 500 ppm
I20260805 22:54:13.747494 29011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:13 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970453, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:13.750905 29011 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:54:13.752796 29011 webserver.cc:460] Webserver started at http://127.20.34.65:33025/ using document root <none> and password file <none>
I20260805 22:54:13.753587 29011 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:13.753727 29011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:13.754089 29011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:13.757619 29011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "94567e55156d4a02855fdafd6bcaf7d2"
format_stamp: "Formatted at 2026-08-05 22:54:13 on dist-test-slave-gmjp"
server_key: "028a3ff3489f4e910273e314cf70dc4f"
server_key_iv: "9707a9e46fb89f9aef45ca6c148e86bb"
server_key_version: "encryptionkey@0"
I20260805 22:54:13.758531 29011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "94567e55156d4a02855fdafd6bcaf7d2"
format_stamp: "Formatted at 2026-08-05 22:54:13 on dist-test-slave-gmjp"
server_key: "028a3ff3489f4e910273e314cf70dc4f"
server_key_iv: "9707a9e46fb89f9aef45ca6c148e86bb"
server_key_version: "encryptionkey@0"
I20260805 22:54:13.764356 29011 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260805 22:54:13.768260 29033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:13.769790 29011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:13.770012 29011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "94567e55156d4a02855fdafd6bcaf7d2"
format_stamp: "Formatted at 2026-08-05 22:54:13 on dist-test-slave-gmjp"
server_key: "028a3ff3489f4e910273e314cf70dc4f"
server_key_iv: "9707a9e46fb89f9aef45ca6c148e86bb"
server_key_version: "encryptionkey@0"
I20260805 22:54:13.770258 29011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:13.797262 29011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:13.801728 29011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:13.802062 29011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:13.803148 29011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:13.804641 29011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:13.804752 29011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:13.804903 29011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:13.804976 29011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:13.840909 29011 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:40975
I20260805 22:54:13.840963 29186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:40975 every 8 connection(s)
I20260805 22:54:13.842352 29011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:54:13.843007 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 29011
I20260805 22:54:13.843251 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:54:13.843935 20617 external_mini_cluster.cc:1428] Setting key 28a015d962b564bb2859c93ee55af665
Aug 05 22:54:13 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970453, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:13.867262 29189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:13.845678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:47445 (local address 127.20.34.126:42277)
0805 22:54:13.846250 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:13.846257 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:13.847483 (+ 1226us) server_negotiation.cc:407] Connection header received
0805 22:54:13.850447 (+ 2964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:13.850452 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:13.850519 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:13.850610 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:13.852862 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:13.853578 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:13.856122 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:13.856609 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:13.856715 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:13.861044 (+ 4329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:13.861050 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:13.861053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:13.861093 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:13.863750 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:13.864713 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:13.864718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:13.864720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:13.864849 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:13.865347 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:13.865351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:13.865353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:13.865647 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:13.865820 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:13.866628 (+ 808us) server_negotiation.cc:299] Negotiation successful
0805 22:54:13.866887 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":281,"threads_started":1}
I20260805 22:54:13.868458 29194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:13.846400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:42277 (local address 127.20.34.65:47445)
0805 22:54:13.847284 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:13.847344 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:13.850152 (+ 2808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:13.850899 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:13.850913 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:13.851768 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:13.852661 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:13.852690 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:13.853746 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:13.853754 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:13.855953 (+ 2199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:13.855975 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:13.856865 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:13.856874 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:13.857216 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:13.858089 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:13.858114 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:13.860762 (+ 2648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:13.863951 (+ 3189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:13.863961 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:13.863987 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:13.864558 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:13.864977 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:13.864982 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:13.864986 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:13.865206 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:13.865801 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:13.865810 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:13.866200 (+ 390us) client_negotiation.cc:769] Sending connection context
0805 22:54:13.866494 (+ 294us) client_negotiation.cc:240] Negotiation successful
0805 22:54:13.867112 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":328,"threads_started":1}
I20260805 22:54:13.870312 29187 heartbeater.cc:347] Connected to a master server at 127.20.34.126:42277
I20260805 22:54:13.870648 29187 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:13.871466 29187 heartbeater.cc:511] Master 127.20.34.126:42277 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
I20260805 22:54:13.874145 28925 ts_manager.cc:194] Registered new tserver with Master: 94567e55156d4a02855fdafd6bcaf7d2 (127.20.34.65:40975)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
I20260805 22:54:13.876103 28925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:47445
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:54:13.908411 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:42277
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:14.269753 29197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:14.270066 29197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:14.270227 29197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:14.278097 29197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:14.278240 29197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:14.278421 29197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:54:14.288914 29197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:42277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:14.290390 29197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:14.291863 29197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:14.306454 29202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:14.306516 29203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:14.306519 29207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:14.307837 29197 server_base.cc:1034] running on GCE node
I20260805 22:54:14.308609 29197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:14.309696 29197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:14.310951 29197 hybrid_clock.cc:648] HybridClock initialized: now 1785970454310907 us; error 47 us; skew 500 ppm
I20260805 22:54:14.311321 29197 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:14 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970454, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:14.314877 29197 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:54:14.316567 29197 webserver.cc:460] Webserver started at http://127.20.34.66:34447/ using document root <none> and password file <none>
I20260805 22:54:14.317278 29197 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:14.317387 29197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:14.317668 29197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:14.320879 29197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "db5d20591f214445b4f9677f0ca5389f"
format_stamp: "Formatted at 2026-08-05 22:54:14 on dist-test-slave-gmjp"
server_key: "d234c8ac0879de096f17d97a4566aa32"
server_key_iv: "b0bf4418678da44e4b9c46945ecc618d"
server_key_version: "encryptionkey@0"
I20260805 22:54:14.321672 29197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "db5d20591f214445b4f9677f0ca5389f"
format_stamp: "Formatted at 2026-08-05 22:54:14 on dist-test-slave-gmjp"
server_key: "d234c8ac0879de096f17d97a4566aa32"
server_key_iv: "b0bf4418678da44e4b9c46945ecc618d"
server_key_version: "encryptionkey@0"
I20260805 22:54:14.327394 29197 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:54:14.331334 29219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:14.332993 29197 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:14.333150 29197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "db5d20591f214445b4f9677f0ca5389f"
format_stamp: "Formatted at 2026-08-05 22:54:14 on dist-test-slave-gmjp"
server_key: "d234c8ac0879de096f17d97a4566aa32"
server_key_iv: "b0bf4418678da44e4b9c46945ecc618d"
server_key_version: "encryptionkey@0"
I20260805 22:54:14.333350 29197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:14.371488 29197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:14.376598 29197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:14.376888 29197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:14.378038 29197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:14.379551 29197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:14.379642 29197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:14.379738 29197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:14.379794 29197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:14.418687 29197 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:43193
I20260805 22:54:14.418776 29373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:43193 every 8 connection(s)
I20260805 22:54:14.420189 29197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:54:14.429034 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 29197
I20260805 22:54:14.429229 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:54:14.429706 20617 external_mini_cluster.cc:1428] Setting key f81ee2862253f423453df3506f4c8018
Aug 05 22:54:14 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970454, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:14.445477 29376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:14.423437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:43545 (local address 127.20.34.126:42277)
0805 22:54:14.424063 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:14.424070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:14.425363 (+ 1293us) server_negotiation.cc:407] Connection header received
0805 22:54:14.427755 (+ 2392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:14.427761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:14.427856 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:14.428001 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:14.429961 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:14.430979 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:14.433041 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:14.433813 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:14.433968 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:14.437910 (+ 3942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:14.437919 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:14.437927 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:14.437976 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:14.441802 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:14.442663 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:14.442672 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:14.442678 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:14.442859 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:14.443320 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:14.443327 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:14.443332 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:14.443743 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:14.443911 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:14.444983 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0805 22:54:14.445189 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":305,"threads_started":1}
I20260805 22:54:14.447147 29378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:14.424041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:42277 (local address 127.20.34.66:43545)
0805 22:54:14.425142 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:14.425216 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:14.427420 (+ 2204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:14.428337 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:14.428346 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:14.428959 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:14.429685 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:14.429705 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:14.431160 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:14.431165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:14.432869 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:14.432891 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:14.434037 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:14.434042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:14.434250 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:14.434986 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:14.435009 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:14.437626 (+ 2617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:14.441992 (+ 4366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:14.442001 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:14.442018 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:14.442508 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:14.442977 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:14.442981 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:14.442983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:14.443189 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:14.443934 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:14.443945 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:14.444506 (+ 561us) client_negotiation.cc:769] Sending connection context
0805 22:54:14.444861 (+ 355us) client_negotiation.cc:240] Negotiation successful
0805 22:54:14.445542 (+ 681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"thread_start_us":458,"threads_started":1}
I20260805 22:54:14.449028 29374 heartbeater.cc:347] Connected to a master server at 127.20.34.126:42277
I20260805 22:54:14.449396 29374 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:14.450217 29374 heartbeater.cc:511] Master 127.20.34.126:42277 requested a full tablet report, sending...
I20260805 22:54:14.452004 28925 ts_manager.cc:194] Registered new tserver with Master: db5d20591f214445b4f9677f0ca5389f (127.20.34.66:43193)
I20260805 22:54:14.453428 28925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:43545
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:54:14.497681 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:42277
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:14.855674 29384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:14.855993 29384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:14.856093 29384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:14.863744 29384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:14.863883 29384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:14.864001 29384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:54:14.874711 29384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:42277
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:14.876333 29384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:14.877792 29384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:54:14.879535 29187 heartbeater.cc:503] Master 127.20.34.126:42277 was elected leader, sending a full tablet report...
W20260805 22:54:14.892541 29391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:14.892587 29392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:14.892504 29395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:14.893481 29384 server_base.cc:1034] running on GCE node
I20260805 22:54:14.894168 29384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:14.895218 29384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:14.896452 29384 hybrid_clock.cc:648] HybridClock initialized: now 1785970454896404 us; error 53 us; skew 500 ppm
I20260805 22:54:14.896800 29384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:14 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970454, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:14.900207 29384 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:54:14.902037 29384 webserver.cc:460] Webserver started at http://127.20.34.67:35521/ using document root <none> and password file <none>
I20260805 22:54:14.902844 29384 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:14.903002 29384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:14.903350 29384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:14.906737 29384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "e45dcfbde5a74dc393291ca904ef4d48"
format_stamp: "Formatted at 2026-08-05 22:54:14 on dist-test-slave-gmjp"
server_key: "7afb73f4993371fe7121b5af456fa453"
server_key_iv: "810d3fd827fc6b1847aa047e0d4711f4"
server_key_version: "encryptionkey@0"
I20260805 22:54:14.907671 29384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "e45dcfbde5a74dc393291ca904ef4d48"
format_stamp: "Formatted at 2026-08-05 22:54:14 on dist-test-slave-gmjp"
server_key: "7afb73f4993371fe7121b5af456fa453"
server_key_iv: "810d3fd827fc6b1847aa047e0d4711f4"
server_key_version: "encryptionkey@0"
I20260805 22:54:14.913635 29384 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 22:54:14.917688 29403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:14.919292 29384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260805 22:54:14.919512 29384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "e45dcfbde5a74dc393291ca904ef4d48"
format_stamp: "Formatted at 2026-08-05 22:54:14 on dist-test-slave-gmjp"
server_key: "7afb73f4993371fe7121b5af456fa453"
server_key_iv: "810d3fd827fc6b1847aa047e0d4711f4"
server_key_version: "encryptionkey@0"
I20260805 22:54:14.919773 29384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:14.954656 29384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:14.959553 29384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:14.959890 29384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:14.961023 29384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:14.962477 29384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:14.962591 29384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:14.962762 29384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:14.962839 29384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:14.999217 29384 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:37139
I20260805 22:54:14.999269 29563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:37139 every 8 connection(s)
I20260805 22:54:15.000712 29384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:54:15.009025 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 29384
I20260805 22:54:15.009233 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:54:15.009893 20617 external_mini_cluster.cc:1428] Setting key 50d159deb3195bd45b0b9f856f458e79
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970454, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:15.023676 29568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:15.003550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:52887 (local address 127.20.34.126:42277)
0805 22:54:15.004052 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.004059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.005198 (+ 1139us) server_negotiation.cc:407] Connection header received
0805 22:54:15.007300 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.007305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.007399 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.007544 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.009474 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.010618 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.013090 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.013706 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.013810 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:15.017534 (+ 3724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:15.017540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:15.017543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:15.017581 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:15.020353 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.021167 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.021171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.021174 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.021306 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.021865 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.021868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.021870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.022146 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:15.022272 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:15.023115 (+ 843us) server_negotiation.cc:299] Negotiation successful
0805 22:54:15.023350 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":212,"threads_started":1}
I20260805 22:54:15.025115 29569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:15.004208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:42277 (local address 127.20.34.67:52887)
0805 22:54:15.005016 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:15.005065 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:15.006992 (+ 1927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:15.007851 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:15.007860 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:15.008560 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:15.009233 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:15.009268 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.010845 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.010850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:15.012930 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:15.012946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.013961 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.013966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:15.014187 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:15.014908 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:15.014938 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:15.017288 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:15.020519 (+ 3231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:15.020526 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:15.020547 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:15.021030 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:15.021465 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:15.021469 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:15.021472 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:15.021741 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:15.022294 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:15.022301 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:15.022688 (+ 387us) client_negotiation.cc:769] Sending connection context
0805 22:54:15.023025 (+ 337us) client_negotiation.cc:240] Negotiation successful
0805 22:54:15.023588 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":325,"threads_started":1}
I20260805 22:54:15.026583 29564 heartbeater.cc:347] Connected to a master server at 127.20.34.126:42277
I20260805 22:54:15.026911 29564 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:15.027654 29564 heartbeater.cc:511] Master 127.20.34.126:42277 requested a full tablet report, sending...
I20260805 22:54:15.029263 28924 ts_manager.cc:194] Registered new tserver with Master: e45dcfbde5a74dc393291ca904ef4d48 (127.20.34.67:37139)
I20260805 22:54:15.030210 28924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:52887
I20260805 22:54:15.038874 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/test-admin.keytab.
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:15.074831 20617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260805 22:54:15.080989 29580 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:15.078025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34470 (local address 127.20.34.65:40975)
0805 22:54:15.078801 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.078814 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.078854 (+ 40us) server_negotiation.cc:407] Connection header received
0805 22:54:15.078930 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.078936 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.079156 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.079356 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.080507 (+ 1151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34470: BlockingRecv error: recv got EOF from 127.0.0.1:34470 (error 108)
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":371,"threads_started":1}
W20260805 22:54:15.081127 20617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:15.082856 20617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:15.084301 20617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:54:15.101377 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:15.086015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34484 (local address 127.20.34.65:40975)
0805 22:54:15.086188 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.086193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.086675 (+ 482us) server_negotiation.cc:407] Connection header received
0805 22:54:15.086857 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.086861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.086923 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.087010 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.088042 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.089071 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.090294 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.090973 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.091095 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:15.095125 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:15.095144 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:15.095162 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:15.095222 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:15.098540 (+ 3318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.099306 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.099314 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.099317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.099455 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.099779 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.099782 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.099784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.100307 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:15.100539 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:15.100874 (+ 335us) server_negotiation.cc:299] Negotiation successful
0805 22:54:15.101090 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260805 22:54:15.108206 29580 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:15.106070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34500 (local address 127.20.34.65:40975)
0805 22:54:15.106311 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.106320 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.106608 (+ 288us) server_negotiation.cc:407] Connection header received
0805 22:54:15.106848 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.106852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.106933 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.107044 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.107850 (+ 806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34500: BlockingRecv error: recv got EOF from 127.0.0.1:34500 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260805 22:54:15.108575 20617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:15.110119 20617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:15.111717 20617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:54:15.127313 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:15.113282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34514 (local address 127.20.34.65:40975)
0805 22:54:15.113712 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.113718 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.113930 (+ 212us) server_negotiation.cc:407] Connection header received
0805 22:54:15.114149 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.114153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.114213 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.114314 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.115347 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.116061 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.117312 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.117775 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.117917 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:15.121695 (+ 3778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:15.121701 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:15.121705 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:15.121739 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:15.124468 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.125244 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.125257 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.125260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.125408 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.125827 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.125833 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.125836 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.126137 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:15.126452 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:15.126757 (+ 305us) server_negotiation.cc:299] Negotiation successful
0805 22:54:15.127009 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291}
W20260805 22:54:15.132252 29580 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:15.130301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34524 (local address 127.20.34.65:40975)
0805 22:54:15.130524 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.130531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.130767 (+ 236us) server_negotiation.cc:407] Connection header received
0805 22:54:15.130971 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.130981 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.131058 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.131161 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.131949 (+ 788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34524: BlockingRecv error: recv got EOF from 127.0.0.1:34524 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260805 22:54:15.132501 20617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970399628623-20617-0/krb5kdc/krb5cc' of type FILE
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:15.134352 20617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:15.135798 20617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:54:15.151430 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:15.137640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34538 (local address 127.20.34.65:40975)
0805 22:54:15.137862 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.137868 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.138086 (+ 218us) server_negotiation.cc:407] Connection header received
0805 22:54:15.138244 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.138250 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.138329 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.138427 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.139494 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.140345 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.141751 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.142169 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.142263 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:15.146094 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:15.146099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:15.146102 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:15.146135 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:15.148848 (+ 2713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.149508 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.149512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.149514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.149651 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.150032 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.150035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.150037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.150327 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:15.150574 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:15.150825 (+ 251us) server_negotiation.cc:299] Negotiation successful
0805 22:54:15.150999 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:54:15.153214 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 29011
I20260805 22:54:15.166680 29580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:15.154016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34542 (local address 127.20.34.65:40975)
0805 22:54:15.154191 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.154198 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.154660 (+ 462us) server_negotiation.cc:407] Connection header received
0805 22:54:15.154804 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.154812 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.154887 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.154987 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.155983 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.157091 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.158289 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.158939 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.159071 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:15.161311 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:15.161325 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:15.161328 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:15.161364 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:15.164148 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.164867 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.164871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.164874 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.165025 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.165393 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.165397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.165399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.165701 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:15.165923 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:15.166196 (+ 273us) server_negotiation.cc:299] Negotiation successful
0805 22:54:15.166395 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 22:54:15.167440 29182 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:15.259240 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 29011
I20260805 22:54:15.286945 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 29197
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:54:15.304777 29599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:15.287935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57714 (local address 127.20.34.66:43193)
0805 22:54:15.288540 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.288548 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.288575 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:54:15.288639 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.288646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.288861 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.289076 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.290161 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.291229 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.292635 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.293232 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.293390 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:15.297933 (+ 4543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:15.297956 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:15.297973 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:15.298030 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:15.301394 (+ 3364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.302265 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.302274 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.302276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.302458 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.302934 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.302939 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.302941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.303344 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:15.303703 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:15.304064 (+ 361us) server_negotiation.cc:299] Negotiation successful
0805 22:54:15.304397 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":307,"threads_started":1}
I20260805 22:54:15.306245 29369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:15.392846 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 29197
I20260805 22:54:15.419174 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 29384
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[28857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:54:15.437363 29601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:15.420426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40792 (local address 127.20.34.67:37139)
0805 22:54:15.421069 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:15.421077 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:15.421108 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:54:15.421172 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:15.421178 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:15.421392 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:15.421530 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:15.423164 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.424459 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.425763 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:15.426366 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:15.426537 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:15.431661 (+ 5124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:15.431677 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:15.431694 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:15.431743 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:15.434692 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.435391 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.435399 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.435401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.435539 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:15.435904 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:15.435907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:15.435909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:15.436353 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:15.436592 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:15.436839 (+ 247us) server_negotiation.cc:299] Negotiation successful
0805 22:54:15.437069 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":315,"threads_started":1}
I20260805 22:54:15.438799 29557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:15.525439 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 29384
I20260805 22:54:15.547391 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 28877
I20260805 22:54:15.548800 28967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:15.657029 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 28877
2026-08-05T22:54:15Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4636 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[29608](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[29608](info): set up 2 sockets
Aug 05 22:54:15 dist-test-slave-gmjp krb5kdc[29608](info): commencing operation
krb5kdc: starting...
W20260805 22:54:17.007001 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:54:17 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:54:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.126.keytab.
Entry for principal oryx/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.126.keytab.
I20260805 22:54:17.311444 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45699
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.126.keytab
--principal=oryx/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:45699
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:17.673803 29626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:17.674165 29626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:17.674341 29626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:17.682065 29626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:17.682204 29626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:17.682300 29626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:17.682394 29626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:17.682476 29626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:17.693581 29626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:45699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.126.keytab
--principal=oryx/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:17.695117 29626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:17.696615 29626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:17.709432 29634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:17.709491 29639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:17.709368 29636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:17.710456 29626 server_base.cc:1034] running on GCE node
I20260805 22:54:17.711386 29626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:17.712966 29626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:17.714215 29626 hybrid_clock.cc:648] HybridClock initialized: now 1785970457714175 us; error 51 us; skew 500 ppm
I20260805 22:54:17.714639 29626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:17 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:17.718081 29626 init.cc:377] Logged in from keytab as oryx/127.20.34.126@KRBTEST.COM (short username oryx)
I20260805 22:54:17.719800 29626 webserver.cc:460] Webserver started at http://127.20.34.126:44719/ using document root <none> and password file <none>
I20260805 22:54:17.720650 29626 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:17.720808 29626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:17.721141 29626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:17.724586 29626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "29b77d7405a843a6bf2c64c4ac6273b7"
format_stamp: "Formatted at 2026-08-05 22:54:17 on dist-test-slave-gmjp"
server_key: "73f54347926e0036b80b3fe3b56ab370"
server_key_iv: "8cbadab4486605926a2b7b5c851f6e73"
server_key_version: "encryptionkey@0"
I20260805 22:54:17.725482 29626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "29b77d7405a843a6bf2c64c4ac6273b7"
format_stamp: "Formatted at 2026-08-05 22:54:17 on dist-test-slave-gmjp"
server_key: "73f54347926e0036b80b3fe3b56ab370"
server_key_iv: "8cbadab4486605926a2b7b5c851f6e73"
server_key_version: "encryptionkey@0"
I20260805 22:54:17.731505 29626 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260805 22:54:17.735327 29648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:17.736936 29626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:17.737154 29626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "29b77d7405a843a6bf2c64c4ac6273b7"
format_stamp: "Formatted at 2026-08-05 22:54:17 on dist-test-slave-gmjp"
server_key: "73f54347926e0036b80b3fe3b56ab370"
server_key_iv: "8cbadab4486605926a2b7b5c851f6e73"
server_key_version: "encryptionkey@0"
I20260805 22:54:17.737373 29626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:17.756270 29626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:17.761241 29626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:17.761582 29626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:17.781632 29626 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:45699
I20260805 22:54:17.781694 29716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:45699 every 8 connection(s)
I20260805 22:54:17.783166 29626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:17.787293 29718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:17.792062 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 29626
I20260805 22:54:17.792325 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:17.793049 20617 external_mini_cluster.cc:1428] Setting key 59df696db8442a1c922115c99f40995a
I20260805 22:54:17.799727 29718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: Bootstrap starting.
I20260805 22:54:17.802976 29718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:17.804031 29718 log.cc:824] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:17.806957 29718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: No bootstrap required, opened a new log
Aug 05 22:54:17 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:17.815392 29718 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } }
I20260805 22:54:17.815881 29718 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:17.816027 29718 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29b77d7405a843a6bf2c64c4ac6273b7, State: Initialized, Role: FOLLOWER
I20260805 22:54:17.816671 29718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } }
I20260805 22:54:17.816921 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:17.795364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36298 (local address 127.20.34.126:45699)
0805 22:54:17.796342 (+ 978us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:17.796355 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:17.796403 (+ 48us) server_negotiation.cc:407] Connection header received
0805 22:54:17.798349 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:17.798376 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:17.798806 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:17.799240 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:17.800930 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:17.802275 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:17.803623 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:17.804419 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:17.804636 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:17.808886 (+ 4250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:17.808894 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:17.808909 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:17.808958 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:17.812254 (+ 3296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:17.812985 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:17.812998 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:17.813005 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:17.813194 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:17.813618 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:17.813633 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:17.813636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:17.814246 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:17.814625 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:17.815072 (+ 447us) server_negotiation.cc:299] Negotiation successful
0805 22:54:17.815516 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":382,"threads_started":1}
I20260805 22:54:17.816942 29718 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:17.817194 29718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:17.817414 29718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:17.820454 29718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } }
I20260805 22:54:17.820921 29718 leader_election.cc:302] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29b77d7405a843a6bf2c64c4ac6273b7; no voters:
I20260805 22:54:17.821571 29718 leader_election.cc:288] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:17.821732 29725 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:17.822459 29725 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 1 LEADER]: Becoming Leader. State: Replica: 29b77d7405a843a6bf2c64c4ac6273b7, State: Running, Role: LEADER
I20260805 22:54:17.823163 29725 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } }
I20260805 22:54:17.824095 29718 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:17.826661 29728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29b77d7405a843a6bf2c64c4ac6273b7. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } }
I20260805 22:54:17.827171 29728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:17.826668 29727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } }
I20260805 22:54:17.829166 29727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:17.829918 29738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:17.834839 29738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:17.844993 29738 catalog_manager.cc:1347] Generated new cluster ID: 11cc724874504bfb8cd1c03b8190d2aa
I20260805 22:54:17.845147 29738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:17.859738 29738 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:17.861302 29738 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:17.867956 29738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: Generated new TSK 0
I20260805 22:54:17.868917 29738 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab.
Entry for principal oryx/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab.
I20260805 22:54:17.953819 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45699
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab
--principal=oryx/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:18.331650 29758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:18.332113 29758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:18.332357 29758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:18.340875 29758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:18.341087 29758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:18.341336 29758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:54:18.352429 29758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab
--principal=oryx/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45699
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:18.353940 29758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:18.355614 29758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:18.371026 29769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:18.371110 29767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:18.371115 29765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:18.372247 29758 server_base.cc:1034] running on GCE node
I20260805 22:54:18.373081 29758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:18.374197 29758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:18.375471 29758 hybrid_clock.cc:648] HybridClock initialized: now 1785970458375436 us; error 53 us; skew 500 ppm
I20260805 22:54:18.375892 29758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260805 22:54:19.211297 29758 net_util.cc:504] Time spent look up canonical hostname for localhost 'dist-test-slave-gmjp': real 0.835s user 0.000s sys 0.000s
Aug 05 22:54:19 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970459, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:19.214063 29758 init.cc:377] Logged in from keytab as oryx/127.20.34.65@KRBTEST.COM (short username oryx)
I20260805 22:54:19.215821 29758 webserver.cc:460] Webserver started at http://127.20.34.65:33485/ using document root <none> and password file <none>
I20260805 22:54:19.216655 29758 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:19.216753 29758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:19.217048 29758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:19.220223 29758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "1b12e075295d4a3f8730b0318d0ab633"
format_stamp: "Formatted at 2026-08-05 22:54:19 on dist-test-slave-gmjp"
server_key: "8bad8e872ae45798f2df0c790b01662b"
server_key_iv: "3562d0cd9213687516f4b82cf847b86e"
server_key_version: "encryptionkey@0"
I20260805 22:54:19.221114 29758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "1b12e075295d4a3f8730b0318d0ab633"
format_stamp: "Formatted at 2026-08-05 22:54:19 on dist-test-slave-gmjp"
server_key: "8bad8e872ae45798f2df0c790b01662b"
server_key_iv: "3562d0cd9213687516f4b82cf847b86e"
server_key_version: "encryptionkey@0"
I20260805 22:54:19.227170 29758 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260805 22:54:19.231246 29778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:19.232895 29758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:19.233083 29758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "1b12e075295d4a3f8730b0318d0ab633"
format_stamp: "Formatted at 2026-08-05 22:54:19 on dist-test-slave-gmjp"
server_key: "8bad8e872ae45798f2df0c790b01662b"
server_key_iv: "3562d0cd9213687516f4b82cf847b86e"
server_key_version: "encryptionkey@0"
I20260805 22:54:19.233356 29758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:19.252573 29758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:19.257138 29758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:19.257495 29758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:19.258750 29758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:19.260428 29758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:19.260526 29758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:19.260680 29758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:19.260771 29758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:19.298285 29758 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:40081
I20260805 22:54:19.298417 29943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:40081 every 8 connection(s)
I20260805 22:54:19.299819 29758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:54:19.303345 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 29758
I20260805 22:54:19.303614 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:54:19.304412 20617 external_mini_cluster.cc:1428] Setting key a187a4ad00ce7db2d8f52653212b4c01
Aug 05 22:54:19 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970459, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:19.322291 29947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:19.302848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:41105 (local address 127.20.34.126:45699)
0805 22:54:19.303461 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:19.303469 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:19.304508 (+ 1039us) server_negotiation.cc:407] Connection header received
0805 22:54:19.307059 (+ 2551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:19.307064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:19.307161 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:19.307288 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:19.309124 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:19.309896 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:19.311554 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:19.311988 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:19.312131 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:19.315904 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:19.315910 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:19.315913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:19.315951 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:19.318799 (+ 2848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:19.319637 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:19.319642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:19.319644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:19.319782 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:19.320335 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:19.320339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:19.320341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:19.320641 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:19.320815 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:19.321607 (+ 792us) server_negotiation.cc:299] Negotiation successful
0805 22:54:19.321877 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":299,"threads_started":1}
I20260805 22:54:19.323427 29948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:19.303362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.65:41105)
0805 22:54:19.304327 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:19.304389 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:19.306724 (+ 2335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:19.307564 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:19.307573 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:19.308285 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:19.308922 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:19.308941 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:19.310083 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:19.310087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:19.311393 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:19.311406 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:19.312292 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:19.312301 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:19.312543 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:19.313290 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:19.313314 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:19.315622 (+ 2308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:19.318977 (+ 3355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:19.318988 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:19.319009 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:19.319484 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:19.319912 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:19.319917 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:19.319921 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:19.320148 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:19.320791 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:19.320800 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:19.321214 (+ 414us) client_negotiation.cc:769] Sending connection context
0805 22:54:19.321513 (+ 299us) client_negotiation.cc:240] Negotiation successful
0805 22:54:19.322152 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":360,"threads_started":1}
I20260805 22:54:19.325362 29944 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45699
I20260805 22:54:19.325759 29944 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:19.326833 29944 heartbeater.cc:511] Master 127.20.34.126:45699 requested a full tablet report, sending...
I20260805 22:54:19.329694 29671 ts_manager.cc:194] Registered new tserver with Master: 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081)
I20260805 22:54:19.332110 29671 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:41105
WARNING: no policy specified for oryx/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab.
Entry for principal oryx/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab.
I20260805 22:54:19.371747 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45699
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab
--principal=oryx/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:19.738436 29953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:19.738770 29953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:19.738878 29953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:19.746461 29953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:19.746592 29953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:19.746713 29953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:54:19.756747 29953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab
--principal=oryx/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45699
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:19.758124 29953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:19.759665 29953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:19.773391 29959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:19.773337 29960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:19.773685 29964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:19.774353 29953 server_base.cc:1034] running on GCE node
I20260805 22:54:19.775041 29953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:19.776057 29953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:19.777281 29953 hybrid_clock.cc:648] HybridClock initialized: now 1785970459777229 us; error 35 us; skew 500 ppm
I20260805 22:54:19.777653 29953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:19 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970459, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:19.781273 29953 init.cc:377] Logged in from keytab as oryx/127.20.34.66@KRBTEST.COM (short username oryx)
I20260805 22:54:19.783031 29953 webserver.cc:460] Webserver started at http://127.20.34.66:44559/ using document root <none> and password file <none>
I20260805 22:54:19.783768 29953 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:19.783928 29953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:19.784327 29953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:19.787585 29953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "49c3826a55054d62acd6bf05ee8d5f3f"
format_stamp: "Formatted at 2026-08-05 22:54:19 on dist-test-slave-gmjp"
server_key: "e97c1847aba7becd1be703a0047e2f4b"
server_key_iv: "9f0543461da2cd4145260195efb0fb97"
server_key_version: "encryptionkey@0"
I20260805 22:54:19.788590 29953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "49c3826a55054d62acd6bf05ee8d5f3f"
format_stamp: "Formatted at 2026-08-05 22:54:19 on dist-test-slave-gmjp"
server_key: "e97c1847aba7becd1be703a0047e2f4b"
server_key_iv: "9f0543461da2cd4145260195efb0fb97"
server_key_version: "encryptionkey@0"
I20260805 22:54:19.794353 29953 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:54:19.798514 29980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:19.800040 29953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:54:19.800261 29953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "49c3826a55054d62acd6bf05ee8d5f3f"
format_stamp: "Formatted at 2026-08-05 22:54:19 on dist-test-slave-gmjp"
server_key: "e97c1847aba7becd1be703a0047e2f4b"
server_key_iv: "9f0543461da2cd4145260195efb0fb97"
server_key_version: "encryptionkey@0"
I20260805 22:54:19.800493 29953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:19.822824 29953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:19.828104 29953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:19.828502 29953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:19.829607 29953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:19.831135 29953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:19.831254 29953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:19.831413 29953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:19.831488 29953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:19.866840 29953 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:37687
I20260805 22:54:19.866885 30151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:37687 every 8 connection(s)
I20260805 22:54:19.868270 29953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:54:19.876838 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 29953
I20260805 22:54:19.877084 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:54:19.877657 20617 external_mini_cluster.cc:1428] Setting key c356326d818d94e731cd298a2e540561
Aug 05 22:54:19 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970459, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:19.889701 30156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:19.871035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:36293 (local address 127.20.34.126:45699)
0805 22:54:19.871558 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:19.871563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:19.872404 (+ 841us) server_negotiation.cc:407] Connection header received
0805 22:54:19.874307 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:19.874313 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:19.874418 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:19.874546 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:19.876124 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:19.876978 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:19.878702 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:19.879150 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:19.879318 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:19.883425 (+ 4107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:19.883431 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:19.883434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:19.883470 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:19.886236 (+ 2766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:19.887029 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:19.887035 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:19.887039 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:19.887176 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:19.887695 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:19.887701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:19.887704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:19.888030 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:19.888225 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:19.889030 (+ 805us) server_negotiation.cc:299] Negotiation successful
0805 22:54:19.889293 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":415,"thread_start_us":293,"threads_started":1}
I20260805 22:54:19.890848 30157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:19.871454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.66:36293)
0805 22:54:19.872238 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:19.872288 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:19.874015 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:19.874810 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:19.874818 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:19.875350 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:19.875927 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:19.875945 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:19.877174 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:19.877178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:19.878531 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:19.878545 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:19.879425 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:19.879433 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:19.879705 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:19.880454 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:19.880484 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:19.883118 (+ 2634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:19.886397 (+ 3279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:19.886406 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:19.886426 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:19.886898 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:19.887303 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:19.887308 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:19.887312 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:19.887561 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:19.888238 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:19.888273 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:19.888645 (+ 372us) client_negotiation.cc:769] Sending connection context
0805 22:54:19.888945 (+ 300us) client_negotiation.cc:240] Negotiation successful
0805 22:54:19.889560 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":282,"threads_started":1}
I20260805 22:54:19.892683 30152 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45699
I20260805 22:54:19.893142 30152 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:19.894323 30152 heartbeater.cc:511] Master 127.20.34.126:45699 requested a full tablet report, sending...
I20260805 22:54:19.896242 29671 ts_manager.cc:194] Registered new tserver with Master: 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66:37687)
I20260805 22:54:19.897233 29671 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:36293
WARNING: no policy specified for oryx/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab.
Entry for principal oryx/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab.
I20260805 22:54:19.943981 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45699
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab
--principal=oryx/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:20.308008 30161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:20.308463 30161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:20.308640 30161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:20.316655 30161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:20.316840 30161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:20.317030 30161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:54:20.327643 30161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab
--principal=oryx/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45699
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:20.329205 30161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:20.330632 30161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:54:20.336218 29944 heartbeater.cc:503] Master 127.20.34.126:45699 was elected leader, sending a full tablet report...
W20260805 22:54:20.345712 30173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:20.345731 30168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:20.345928 30171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:20.346774 30161 server_base.cc:1034] running on GCE node
I20260805 22:54:20.347513 30161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:20.348598 30161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:20.349872 30161 hybrid_clock.cc:648] HybridClock initialized: now 1785970460349814 us; error 45 us; skew 500 ppm
I20260805 22:54:20.350248 30161 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:20 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970460, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:20.353683 30161 init.cc:377] Logged in from keytab as oryx/127.20.34.67@KRBTEST.COM (short username oryx)
I20260805 22:54:20.355170 30161 webserver.cc:460] Webserver started at http://127.20.34.67:44315/ using document root <none> and password file <none>
I20260805 22:54:20.356016 30161 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:20.356129 30161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:20.356487 30161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:20.359652 30161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "ff96b77e85fb4ab18f5626aa0335c89f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f09d2c75da23437c4aaee3d024df9a96"
server_key_iv: "d622df2405839adea687c5cd6ccf0ae0"
server_key_version: "encryptionkey@0"
I20260805 22:54:20.360586 30161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "ff96b77e85fb4ab18f5626aa0335c89f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f09d2c75da23437c4aaee3d024df9a96"
server_key_iv: "d622df2405839adea687c5cd6ccf0ae0"
server_key_version: "encryptionkey@0"
I20260805 22:54:20.366468 30161 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260805 22:54:20.370108 30183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:20.371542 30161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:54:20.371722 30161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "ff96b77e85fb4ab18f5626aa0335c89f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f09d2c75da23437c4aaee3d024df9a96"
server_key_iv: "d622df2405839adea687c5cd6ccf0ae0"
server_key_version: "encryptionkey@0"
I20260805 22:54:20.371922 30161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:20.386656 30161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:20.391652 30161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:20.392084 30161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:20.393414 30161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:20.395211 30161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:20.395314 30161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:20.395499 30161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:20.395569 30161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:20.436821 30161 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:40523
I20260805 22:54:20.436918 30341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:40523 every 8 connection(s)
I20260805 22:54:20.438405 30161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:54:20.445190 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 30161
I20260805 22:54:20.445420 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:54:20.445992 20617 external_mini_cluster.cc:1428] Setting key dab7065ff00969566084c9fa0ef5b0bc
Aug 05 22:54:20 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970460, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:20.461346 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:20.441296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:45621 (local address 127.20.34.126:45699)
0805 22:54:20.441859 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:20.441864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:20.443048 (+ 1184us) server_negotiation.cc:407] Connection header received
0805 22:54:20.445053 (+ 2005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:20.445059 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:20.445181 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:20.445325 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:20.447678 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:20.449078 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:20.451210 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:20.451645 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:20.451747 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:20.455355 (+ 3608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:20.455360 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:20.455364 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:20.455413 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:20.458169 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:20.458882 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:20.458886 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:20.458888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:20.459010 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:20.459406 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:20.459409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:20.459411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:20.459683 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:20.459808 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:20.460682 (+ 874us) server_negotiation.cc:299] Negotiation successful
0805 22:54:20.460932 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":327,"threads_started":1}
I20260805 22:54:20.462486 30346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:20.442013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.67:45621)
0805 22:54:20.442869 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:20.442913 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:20.444718 (+ 1805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:20.445653 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:20.445662 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:20.446452 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:20.447413 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:20.447444 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:20.449288 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:20.449293 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:20.451070 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:20.451083 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:20.451846 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:20.451851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:20.452054 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:20.452805 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:20.452832 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:20.455127 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:20.458304 (+ 3177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:20.458311 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:20.458332 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:20.458776 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:20.459105 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:20.459108 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:20.459111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:20.459295 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:20.459857 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:20.459873 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:20.460313 (+ 440us) client_negotiation.cc:769] Sending connection context
0805 22:54:20.460594 (+ 281us) client_negotiation.cc:240] Negotiation successful
0805 22:54:20.461035 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":338,"threads_started":1}
I20260805 22:54:20.463903 30342 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45699
I20260805 22:54:20.464272 30342 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:20.464995 30342 heartbeater.cc:511] Master 127.20.34.126:45699 requested a full tablet report, sending...
I20260805 22:54:20.466462 29671 ts_manager.cc:194] Registered new tserver with Master: ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523)
I20260805 22:54:20.467231 29671 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:45621
I20260805 22:54:20.475783 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.34.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.125.keytab.
Entry for principal oryx/127.20.34.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.125.keytab.
I20260805 22:54:20.545042 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.125:34617
--webserver_interface=127.20.34.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.125.keytab
--principal=oryx/127.20.34.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:45699,127.20.34.125:34617
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:54:20.900379 30152 heartbeater.cc:503] Master 127.20.34.126:45699 was elected leader, sending a full tablet report...
W20260805 22:54:20.928040 30352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:20.928500 30352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:20.928678 30352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:20.937428 30352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:20.937613 30352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:20.937723 30352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:20.937857 30352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:20.937947 30352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:20.949965 30352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:45699,127.20.34.125:34617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.125.keytab
--principal=oryx/127.20.34.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.125:34617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.34.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
W20260805 22:54:20.950443 30352 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.34.126:45699,127.20.34.125:34617'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260805 22:54:20.951607 30352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:20.953092 30352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:20.965948 30359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:20.966004 30360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:20.966030 30363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:20.967311 30352 server_base.cc:1034] running on GCE node
I20260805 22:54:20.968134 30352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:20.969815 30352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:20.971184 30352 hybrid_clock.cc:648] HybridClock initialized: now 1785970460971100 us; error 58 us; skew 500 ppm
I20260805 22:54:20.971587 30352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:20 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970460, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:20.975374 30352 init.cc:377] Logged in from keytab as oryx/127.20.34.125@KRBTEST.COM (short username oryx)
I20260805 22:54:20.977329 30352 webserver.cc:460] Webserver started at http://127.20.34.125:39507/ using document root <none> and password file <none>
I20260805 22:54:20.978145 30352 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:20.978252 30352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:20.978662 30352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:20.982177 30352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data/instance:
uuid: "2490eb41836b4fa394d342df606b919f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f8b4f1c3decafe9fb7fdc584a85ca4f3"
server_key_iv: "7839e3f1160cdf80b6875ed8a930fdc7"
server_key_version: "encryptionkey@0"
I20260805 22:54:20.983080 30352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal/instance:
uuid: "2490eb41836b4fa394d342df606b919f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f8b4f1c3decafe9fb7fdc584a85ca4f3"
server_key_iv: "7839e3f1160cdf80b6875ed8a930fdc7"
server_key_version: "encryptionkey@0"
I20260805 22:54:20.989257 30352 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 22:54:20.993201 30371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:20.994676 30352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260805 22:54:20.994892 30352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
uuid: "2490eb41836b4fa394d342df606b919f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f8b4f1c3decafe9fb7fdc584a85ca4f3"
server_key_iv: "7839e3f1160cdf80b6875ed8a930fdc7"
server_key_version: "encryptionkey@0"
I20260805 22:54:20.995144 30352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:21.023351 30352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:21.028226 30352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:21.028561 30352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:21.049554 30352 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.125:34617
I20260805 22:54:21.049566 30449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.125:34617 every 8 connection(s)
I20260805 22:54:21.051101 30352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
I20260805 22:54:21.055657 30451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:21.056393 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 30352
I20260805 22:54:21.066270 30451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.125@KRBTEST.COM
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970460, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.125@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:21.084329 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.059120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46840 (local address 127.20.34.125:34617)
0805 22:54:21.060051 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.060064 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.060109 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:54:21.062662 (+ 2553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.062690 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.063260 (+ 570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.063651 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.065730 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.067105 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.069036 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.070340 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.070542 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.075890 (+ 5348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.075899 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.075912 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.075954 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.079914 (+ 3960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.080744 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.080752 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.080760 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.080926 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.081355 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.081362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.081370 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.081920 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.082247 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.082768 (+ 521us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.083190 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":443,"threads_started":1}
I20260805 22:54:21.087101 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.069524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36314 (local address 127.20.34.126:45699)
0805 22:54:21.070140 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.070149 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.070868 (+ 719us) server_negotiation.cc:407] Connection header received
0805 22:54:21.071092 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.071096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.071172 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.071266 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.072545 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.073805 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.075697 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.076223 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.076344 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.080957 (+ 4613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.080963 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.080966 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.081002 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.083891 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.084828 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.084835 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.084839 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.084981 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.085399 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.085406 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.085408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.085794 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.085976 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.086474 (+ 498us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.086702 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":354,"threads_started":1}
I20260805 22:54:21.087139 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.069627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:36314)
0805 22:54:21.070677 (+ 1050us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.070743 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.070932 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.071376 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.071386 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.072039 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.072364 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.072374 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.074007 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.074013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.075537 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.075552 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.076436 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.076445 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.077126 (+ 681us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.077850 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.077879 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.080720 (+ 2841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.084031 (+ 3311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.084045 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.084052 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.084700 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.085103 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.085108 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.085112 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.085251 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.085948 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.085956 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.086145 (+ 189us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.086354 (+ 209us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.086700 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":593,"threads_started":1}
I20260805 22:54:21.089165 30451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970460, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.125@KRBTEST.COM for oryx/127.20.34.125@KRBTEST.COM
I20260805 22:54:21.102372 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.089987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.0.0.1:46844)
0805 22:54:21.090205 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.090227 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.090378 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.090675 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.090680 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.091108 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.091248 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.091257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.092322 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.092327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.093233 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.093246 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.093945 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.093951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.094147 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.094715 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.094738 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.096968 (+ 2230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.099864 (+ 2896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.099871 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.099875 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.100350 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.100710 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.100714 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.100718 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.100848 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.101374 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.101379 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.101531 (+ 152us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.101668 (+ 137us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.101988 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":1}
I20260805 22:54:21.102427 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.089952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46844 (local address 127.20.34.125:34617)
0805 22:54:21.090197 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.090212 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.090309 (+ 97us) server_negotiation.cc:407] Connection header received
0805 22:54:21.090489 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.090494 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.090554 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.090656 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.091392 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.092105 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.093376 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.093791 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.093932 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.097140 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.097153 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.097157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.097185 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.099737 (+ 2552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.100465 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.100472 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.100476 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.100593 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.100953 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.100959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.100962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.101256 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.101409 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.101759 (+ 350us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.102122 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":162,"server-negotiator.queue_time_us":102}
I20260805 22:54:21.107918 30451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Bootstrap starting.
I20260805 22:54:21.111326 30451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:21.112484 30451 log.cc:824] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:21.115303 30451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: No bootstrap required, opened a new log
I20260805 22:54:21.122699 30451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } }
I20260805 22:54:21.123061 30451 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:21.123147 30451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2490eb41836b4fa394d342df606b919f, State: Initialized, Role: FOLLOWER
I20260805 22:54:21.123713 30451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } }
I20260805 22:54:21.124751 30465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } } }
I20260805 22:54:21.125126 30465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:54:21.125959 30451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:54:21.135792 30480 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:54:21.135972 30480 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:54:21.138767 30352 master_runner.cc:428] Detected that this master 2490eb41836b4fa394d342df606b919f is joining an existing cluster
I20260805 22:54:21.138934 30352 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.34.125:34617
I20260805 22:54:21.170661 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.151924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46848 (local address 127.20.34.125:34617)
0805 22:54:21.152379 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.152386 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.153391 (+ 1005us) server_negotiation.cc:407] Connection header received
0805 22:54:21.153670 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.153676 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.153753 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.153826 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.155431 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.156688 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.158777 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.159612 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.159759 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.162589 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.162596 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.162602 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.162638 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.166784 (+ 4146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.167683 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.167688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.167692 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.167836 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.168368 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.168379 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.168382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.168839 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.168996 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.169553 (+ 557us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.169821 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 22:54:21.171819 30491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.152540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.0.0.1:46848)
0805 22:54:21.153258 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.153284 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.153508 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.154066 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.154071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.154785 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.155265 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.155280 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.156952 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.156957 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.158618 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.158637 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.160109 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.160120 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.160346 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.161131 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.161155 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.162359 (+ 1204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.166983 (+ 4624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.166989 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.166993 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.167554 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.167996 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.168001 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.168004 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.168230 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.169099 (+ 869us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.169104 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.169275 (+ 171us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.170231 (+ 956us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.171331 (+ 1100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":392,"threads_started":1}
WARNING: no policy specified for oryx/127.20.34.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.124@KRBTEST.COM" created.
I20260805 22:54:21.185837 30493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.153481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:36330)
0805 22:54:21.168744 (+ 15263us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.168766 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.168910 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.169578 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.169589 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.170887 (+ 1298us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.171527 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.171545 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.173420 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.173426 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.175177 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.175198 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.176347 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.176353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.176480 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.177259 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.177281 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.178263 (+ 982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.182481 (+ 4218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.182487 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.182491 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.183037 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.183528 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.183533 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.183537 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.183696 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.184516 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.184523 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.184755 (+ 232us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.184927 (+ 172us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.185310 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15100,"thread_start_us":14860,"threads_started":1}
I20260805 22:54:21.186784 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.151913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36330 (local address 127.20.34.126:45699)
0805 22:54:21.152133 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.152139 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.168900 (+ 16761us) server_negotiation.cc:407] Connection header received
0805 22:54:21.169044 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.169053 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.169210 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.169333 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.171780 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.173003 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.175367 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.176117 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.176298 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.178508 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.178515 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.178520 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.178566 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.182289 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.183200 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.183209 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.183213 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.183379 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.183834 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.183839 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.183843 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.184284 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.184429 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.186198 (+ 1769us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.186459 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.126@KRBTEST.COM for oryx/127.20.34.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.124.keytab.
Entry for principal oryx/127.20.34.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.124.keytab.
I20260805 22:54:21.220758 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.124:46781
--webserver_interface=127.20.34.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.124.keytab
--principal=oryx/127.20.34.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:45699,127.20.34.125:34617,127.20.34.124:46781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:54:21.221351 30496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.198864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.0.0.1:46862)
0805 22:54:21.200133 (+ 1269us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.200207 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.200494 (+ 287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.201091 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.201102 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.202099 (+ 997us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.202452 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.202469 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.203986 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.203993 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.205718 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.205737 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.206973 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.206980 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.207211 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.208063 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.208089 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.212920 (+ 4831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.217481 (+ 4561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.217504 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.217513 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.218204 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.218786 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.218793 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.218797 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.219026 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.219946 (+ 920us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.219956 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.220233 (+ 277us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.220475 (+ 242us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.220897 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1006,"thread_start_us":830,"threads_started":1}
I20260805 22:54:21.221407 30455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.199306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46862 (local address 127.20.34.125:34617)
0805 22:54:21.199544 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.199553 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.200312 (+ 759us) server_negotiation.cc:407] Connection header received
0805 22:54:21.200737 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.200744 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.200851 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.200996 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.202633 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.203793 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.205904 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.206748 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.206916 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.213272 (+ 6356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.213281 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.213289 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.213349 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.217312 (+ 3963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.218356 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.218362 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.218364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.218639 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.219168 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.219174 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.219177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.219712 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.219932 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.220632 (+ 700us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.220914 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260805 22:54:21.223891 29671 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.34.125:34617: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "2490eb41836b4fa394d342df606b919f"
member_type: NON_VOTER
last_known_addr {
host: "127.20.34.125"
port: 34617
}
attrs {
promote: true
}
}
dest_uuid: "29b77d7405a843a6bf2c64c4ac6273b7"
cas_config_opid_index: -1
I20260805 22:54:21.225829 29671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } }
I20260805 22:54:21.234932 30499 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 2490eb41836b4fa394d342df606b919f (127.20.34.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } }
I20260805 22:54:21.236195 30414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:21.240197 30499 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.34.125:34617
I20260805 22:54:21.240583 30414 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Refusing update from remote peer 29b77d7405a843a6bf2c64c4ac6273b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260805 22:54:21.241299 30352 master.cc:537] Master@127.20.34.125:34617 shutting down...
I20260805 22:54:21.242123 30499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } }
I20260805 22:54:21.242479 30499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:21.245141 30499 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:54:21.249415 29652 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260805 22:54:21.257339 30352 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:21.258028 30352 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:21.258344 30352 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: stopping tablet replica
W20260805 22:54:21.264087 29652 consensus_peers.cc:487] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 -> Peer 2490eb41836b4fa394d342df606b919f (127.20.34.125:34617): Couldn't send request to peer 2490eb41836b4fa394d342df606b919f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260805 22:54:21.278368 30352 master.cc:552] Master@127.20.34.125:34617 shutdown complete.
I20260805 22:54:21.278542 30352 master_runner.cc:305] Clearing existing system tablet
I20260805 22:54:21.279083 30352 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:21.279192 30352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:21.282552 30352 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260805 22:54:21.284520 30505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:21.284924 30352 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:21.285211 30352 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260805 22:54:21.285328 30352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
uuid: "2490eb41836b4fa394d342df606b919f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f8b4f1c3decafe9fb7fdc584a85ca4f3"
server_key_iv: "7839e3f1160cdf80b6875ed8a930fdc7"
server_key_version: "encryptionkey@0"
I20260805 22:54:21.290890 30352 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:21.298637 30352 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260805 22:54:21.298931 30352 log.cc:1196] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260805 22:54:21.299446 30352 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Deleting consensus metadata
I20260805 22:54:21.299777 30352 master_runner.cc:315] Copying system tablet from 127.20.34.126:45699
I20260805 22:54:21.304141 30352 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.34.126:45699
I20260805 22:54:21.321954 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.305344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36344 (local address 127.20.34.126:45699)
0805 22:54:21.305554 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.305561 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.306141 (+ 580us) server_negotiation.cc:407] Connection header received
0805 22:54:21.306407 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.306415 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.306526 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.306663 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.307896 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.309494 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.311574 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.312318 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.312471 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.314953 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.314960 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.314965 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.315009 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.318656 (+ 3647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.319611 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.319617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.319620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.319782 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.320273 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.320278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.320281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.320690 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.320844 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.321337 (+ 493us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.321587 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 22:54:21.322052 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.305360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:36344)
0805 22:54:21.305982 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.306011 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.306190 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.306727 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.306732 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.307370 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.307685 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.307700 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.309697 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.309709 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.311370 (+ 1661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.311389 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.312511 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.312518 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.312730 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.313516 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.313541 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.314685 (+ 1144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.318823 (+ 4138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.318829 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.318834 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.319457 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.319922 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.319928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.319931 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.320138 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.320843 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.320849 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.321044 (+ 195us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.321212 (+ 168us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.321573 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":344,"threads_started":1}
I20260805 22:54:21.323426 29698 tablet_copy_service.cc:140] P 29b77d7405a843a6bf2c64c4ac6273b7: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 2490eb41836b4fa394d342df606b919f ({username='oryx', principal='oryx/127.20.34.125@KRBTEST.COM'} at 127.0.0.1:36344)
I20260805 22:54:21.323868 29698 tablet_copy_service.cc:161] P 29b77d7405a843a6bf2c64c4ac6273b7: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 2490eb41836b4fa394d342df606b919f at {username='oryx', principal='oryx/127.20.34.125@KRBTEST.COM'} at 127.0.0.1:36344: session id = 2490eb41836b4fa394d342df606b919f-00000000000000000000000000000000
I20260805 22:54:21.328908 29698 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 22:54:21.332047 30352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260805 22:54:21.339780 30352 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: tablet copy: Starting download of 0 data blocks...
I20260805 22:54:21.340281 30352 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: tablet copy: Starting download of 1 WAL segments...
I20260805 22:54:21.345490 30352 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 22:54:21.351400 29698 tablet_copy_service.cc:342] P 29b77d7405a843a6bf2c64c4ac6273b7: Request end of tablet copy session 2490eb41836b4fa394d342df606b919f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.34.125@KRBTEST.COM'} at 127.0.0.1:36344
I20260805 22:54:21.351755 29698 tablet_copy_service.cc:433] P 29b77d7405a843a6bf2c64c4ac6273b7: ending tablet copy session 2490eb41836b4fa394d342df606b919f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 2490eb41836b4fa394d342df606b919f
I20260805 22:54:21.364001 30352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:21.366786 30513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:21.369642 30514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:21.375638 30518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:21.376994 30352 server_base.cc:1034] running on GCE node
I20260805 22:54:21.377346 30352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:21.378171 30352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:21.379493 30352 hybrid_clock.cc:648] HybridClock initialized: now 1785970461379418 us; error 52 us; skew 500 ppm
I20260805 22:54:21.379755 30352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970461, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:21.381851 30352 init.cc:377] Logged in from keytab as oryx/127.20.34.125@KRBTEST.COM (short username oryx)
I20260805 22:54:21.386034 30352 webserver.cc:460] Webserver started at http://127.20.34.125:44267/ using document root <none> and password file <none>
I20260805 22:54:21.386448 30352 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:21.386556 30352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:21.389297 30352 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260805 22:54:21.391218 30527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:21.391675 30352 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260805 22:54:21.391839 30352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
uuid: "2490eb41836b4fa394d342df606b919f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f8b4f1c3decafe9fb7fdc584a85ca4f3"
server_key_iv: "7839e3f1160cdf80b6875ed8a930fdc7"
server_key_version: "encryptionkey@0"
I20260805 22:54:21.392024 30352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:21.411247 30352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:21.414887 30352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:21.448942 30352 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.125:34617
I20260805 22:54:21.448966 30605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.125:34617 every 8 connection(s)
I20260805 22:54:21.450371 30352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
I20260805 22:54:21.461581 30607 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:54:21.465626 30607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Bootstrap starting.
I20260805 22:54:21.469925 30342 heartbeater.cc:503] Master 127.20.34.126:45699 was elected leader, sending a full tablet report...
I20260805 22:54:21.492681 30607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:54:21.493378 30607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Bootstrap complete.
I20260805 22:54:21.494620 30607 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } }
I20260805 22:54:21.494921 30607 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2490eb41836b4fa394d342df606b919f, State: Initialized, Role: LEARNER
I20260805 22:54:21.495257 30607 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } }
I20260805 22:54:21.496229 30612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } }
I20260805 22:54:21.496655 30607 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:21.496733 30612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: This master's current role is: LEARNER
I20260805 22:54:21.513748 30624 catalog_manager.cc:1259] Loaded cluster ID: 11cc724874504bfb8cd1c03b8190d2aa
I20260805 22:54:21.513896 30624 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: loading cluster ID for follower catalog manager: success
I20260805 22:54:21.517764 30624 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: acquiring CA information for follower catalog manager: success
I20260805 22:54:21.520699 30624 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260805 22:54:21.683449 30501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:21.683758 30501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:21.683853 30501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:21.691426 30501 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:21.691597 30501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:21.691699 30501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:21.691802 30501 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:21.691869 30501 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:21.703032 30501 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:45699,127.20.34.125:34617,127.20.34.124:46781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.124.keytab
--principal=oryx/127.20.34.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.124:46781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.34.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:21.704607 30501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:21.706218 30501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:21.719033 30632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:21.719036 30633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:21.718991 30635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:21.720255 30501 server_base.cc:1034] running on GCE node
I20260805 22:54:21.721163 30501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:21.722764 30501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:21.723956 30501 hybrid_clock.cc:648] HybridClock initialized: now 1785970461723889 us; error 62 us; skew 500 ppm
I20260805 22:54:21.724424 30501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970461, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:21.728077 30501 init.cc:377] Logged in from keytab as oryx/127.20.34.124@KRBTEST.COM (short username oryx)
I20260805 22:54:21.729858 30501 webserver.cc:460] Webserver started at http://127.20.34.124:40745/ using document root <none> and password file <none>
I20260805 22:54:21.730573 30501 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:21.730680 30501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:21.730960 30501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:21.734302 30501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data/instance:
uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f"
format_stamp: "Formatted at 2026-08-05 22:54:21 on dist-test-slave-gmjp"
server_key: "d5e3dda470af06acea9f2b667b38c454"
server_key_iv: "b6dec750e9d7aeb314f40ee8e057e281"
server_key_version: "encryptionkey@0"
I20260805 22:54:21.735065 30501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal/instance:
uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f"
format_stamp: "Formatted at 2026-08-05 22:54:21 on dist-test-slave-gmjp"
server_key: "d5e3dda470af06acea9f2b667b38c454"
server_key_iv: "b6dec750e9d7aeb314f40ee8e057e281"
server_key_version: "encryptionkey@0"
I20260805 22:54:21.740911 30501 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:54:21.744856 30646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:21.746477 30501 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:21.746693 30501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f"
format_stamp: "Formatted at 2026-08-05 22:54:21 on dist-test-slave-gmjp"
server_key: "d5e3dda470af06acea9f2b667b38c454"
server_key_iv: "b6dec750e9d7aeb314f40ee8e057e281"
server_key_version: "encryptionkey@0"
I20260805 22:54:21.746914 30501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:21.764879 30501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:21.769606 30501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:21.769910 30501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:21.791445 30501 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.124:46781
I20260805 22:54:21.791462 30711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.124:46781 every 8 connection(s)
I20260805 22:54:21.793283 30501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
I20260805 22:54:21.796584 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 30501
I20260805 22:54:21.798290 30712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:21.810151 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.797334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.0.0.1:46874)
0805 22:54:21.799254 (+ 1920us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.799273 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.799461 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.800205 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.800211 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.800246 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:21.800490 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.800504 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.802888 (+ 2384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.802898 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.806070 (+ 3172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.806096 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.808865 (+ 2769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.808876 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.809153 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.809260 (+ 107us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.809409 (+ 149us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.809643 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1792,"thread_start_us":1824,"threads_started":1}
I20260805 22:54:21.811393 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.797688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46874 (local address 127.20.34.125:34617)
0805 22:54:21.798904 (+ 1216us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.798911 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.799609 (+ 698us) server_negotiation.cc:407] Connection header received
0805 22:54:21.799701 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.799706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.799801 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.799931 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:21.800676 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.802669 (+ 1993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.806348 (+ 3679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.808207 (+ 1859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.808391 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.808704 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.810614 (+ 1910us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.810900 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1056,"thread_start_us":1624,"threads_started":1}
I20260805 22:54:21.812848 30570 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260805 22:54:21.811741 30712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:54:21.813923 30612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29b77d7405a843a6bf2c64c4ac6273b7. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } }
I20260805 22:54:21.814268 30612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: This master's current role is: LEARNER
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970461, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.124@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.124@KRBTEST.COM
I20260805 22:54:21.834947 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.816210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36354 (local address 127.20.34.126:45699)
0805 22:54:21.816397 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.816406 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.817257 (+ 851us) server_negotiation.cc:407] Connection header received
0805 22:54:21.818803 (+ 1546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.818809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.818899 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.819017 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.820502 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.821268 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.822849 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.823285 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.823427 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.827640 (+ 4213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.827650 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.827656 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.827709 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.831361 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.832329 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.832334 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.832336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.832520 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.833005 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.833009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.833012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.833360 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.833537 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.834319 (+ 782us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.834571 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:54:21.836272 30725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.816196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:36354)
0805 22:54:21.817089 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.817152 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.818531 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.819105 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.819113 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.819850 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.820330 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.820351 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.821415 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.821423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.822664 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.822677 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.823545 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.823552 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.823810 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.824642 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.824677 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.827375 (+ 2698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.831517 (+ 4142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.831530 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.831542 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.832113 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.832650 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.832657 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.832660 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.832857 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.833506 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.833516 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.833903 (+ 387us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.834214 (+ 311us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.834787 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"mutex_wait_us":50,"thread_start_us":438,"threads_started":1}
I20260805 22:54:21.836294 30723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.800892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60944 (local address 127.20.34.124:46781)
0805 22:54:21.815736 (+ 14844us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.815748 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.816455 (+ 707us) server_negotiation.cc:407] Connection header received
0805 22:54:21.818514 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.818539 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.818797 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.819024 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.820692 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.821897 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.823155 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.823743 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.823899 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.828840 (+ 4941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.828855 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.828878 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.828933 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.832562 (+ 3629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.833278 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.833289 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.833293 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.833456 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.833872 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.833877 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.833881 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.834240 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.834567 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.834926 (+ 359us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.835183 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":14611,"thread_start_us":14363,"threads_started":1}
I20260805 22:54:21.838160 30712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970461, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.124@KRBTEST.COM for oryx/127.20.34.125@KRBTEST.COM
I20260805 22:54:21.851481 30725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.838789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.0.0.1:46890)
0805 22:54:21.839025 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.839045 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.839154 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.839756 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.839760 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.840118 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.840380 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.840395 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.841442 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.841447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.842411 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.842422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.843159 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.843164 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.843376 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.843931 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.843948 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.845993 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.848940 (+ 2947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.848945 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.848949 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.849328 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.849720 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.849725 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.849744 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.849884 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.850439 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.850443 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.850625 (+ 182us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.850778 (+ 153us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.851110 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260805 22:54:21.851481 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.839078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46890 (local address 127.20.34.125:34617)
0805 22:54:21.839249 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.839253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.839268 (+ 15us) server_negotiation.cc:407] Connection header received
0805 22:54:21.839317 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.839321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.839435 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.839533 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.840544 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.841271 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.842571 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.842999 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.843135 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.846189 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.846195 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.846199 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.846233 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.848793 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.849452 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.849458 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.849461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.849602 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.849998 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.850004 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.850007 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.850287 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.850483 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.850885 (+ 402us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.851158 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:54:21.852705 30712 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970461, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.124@KRBTEST.COM for oryx/127.20.34.124@KRBTEST.COM
I20260805 22:54:21.865283 30725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.853337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.0.0.1:60956)
0805 22:54:21.853548 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.853573 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.853654 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.853914 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.853917 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.854246 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.854395 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.854403 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.855306 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.855310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.856267 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.856278 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.856916 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.856920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.857058 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.857588 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.857605 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.859603 (+ 1998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.862737 (+ 3134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.862741 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.862743 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.863117 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.863443 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.863446 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.863448 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.863594 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.864127 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.864131 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.864361 (+ 230us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.864611 (+ 250us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.864904 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260805 22:54:21.865307 30723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.853470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60956 (local address 127.20.34.124:46781)
0805 22:54:21.853608 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.853612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.853628 (+ 16us) server_negotiation.cc:407] Connection header received
0805 22:54:21.853744 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.853747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.853801 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.853889 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.854509 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.855200 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.856395 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.856779 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.856889 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.859795 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.859801 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.859804 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.859835 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.862605 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.863224 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.863228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.863230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.863348 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.863687 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.863690 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.863692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.863978 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.864099 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.864739 (+ 640us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.865057 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":110,"server-negotiator.queue_time_us":51}
I20260805 22:54:21.870329 30712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Bootstrap starting.
I20260805 22:54:21.873682 30712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:21.874774 30712 log.cc:824] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:21.877904 30712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: No bootstrap required, opened a new log
I20260805 22:54:21.885752 30712 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } }
I20260805 22:54:21.886154 30712 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:21.886283 30712 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3dc7fe64fee44f1a48fc07f2c85a53f, State: Initialized, Role: FOLLOWER
I20260805 22:54:21.886969 30712 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } }
I20260805 22:54:21.887979 30727 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } } }
I20260805 22:54:21.888550 30727 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:54:21.889209 30712 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:54:21.898947 30744 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:54:21.899132 30744 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:54:21.905231 30501 master_runner.cc:428] Detected that this master a3dc7fe64fee44f1a48fc07f2c85a53f is joining an existing cluster
I20260805 22:54:21.905385 30501 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.34.124:46781
I20260805 22:54:21.930667 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.910376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36366 (local address 127.20.34.126:45699)
0805 22:54:21.910603 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.910610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.911577 (+ 967us) server_negotiation.cc:407] Connection header received
0805 22:54:21.911918 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.911925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.912022 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.912109 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.913848 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.915038 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.917312 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.917987 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.918102 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.921581 (+ 3479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.921590 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.921598 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.921664 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.926041 (+ 4377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.927338 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.927345 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.927348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.927528 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.928107 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.928113 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.928116 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.928522 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.928683 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.929704 (+ 1021us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.929980 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260805 22:54:21.931646 30720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.910812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46906 (local address 127.20.34.125:34617)
0805 22:54:21.911062 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.911069 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.911742 (+ 673us) server_negotiation.cc:407] Connection header received
0805 22:54:21.912032 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.912038 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.912177 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.912275 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.915602 (+ 3327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.917084 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.919572 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.920354 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.920490 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.923253 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.923260 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.923265 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.923313 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.927054 (+ 3741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.928083 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.928089 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.928093 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.928288 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.928807 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.928813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.928816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.929229 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.929386 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.931033 (+ 1647us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.931293 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 22:54:21.931869 30760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.910535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:36366)
0805 22:54:21.911444 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.911469 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.911723 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.912401 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.912406 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.913231 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.913633 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.913648 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.915268 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.915273 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.917124 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.917142 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.918426 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.918433 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.918659 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.919755 (+ 1096us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.919780 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.921303 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.926480 (+ 5177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.926486 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.926492 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.927168 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.927696 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.927701 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.927705 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.927965 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.928781 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.928786 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.929308 (+ 522us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.930978 (+ 1670us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.931369 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"spinlock_wait_cycles":1280,"thread_start_us":523,"threads_started":1}
I20260805 22:54:21.932225 30761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.910615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.0.0.1:46906)
0805 22:54:21.911616 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.911635 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.911861 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.913934 (+ 2073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.913942 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.914856 (+ 914us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.915353 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.915369 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.917342 (+ 1973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.917350 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.919368 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.919380 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.920779 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.920792 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.921025 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.921712 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.921735 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.923016 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.927218 (+ 4202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.927223 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.927227 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.927944 (+ 717us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.928431 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.928436 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.928440 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.928637 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.929471 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.929478 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.929739 (+ 261us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.929904 (+ 165us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.930307 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":852,"spinlock_wait_cycles":30464,"thread_start_us":622,"threads_started":1}
I20260805 22:54:21.936479 30723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.911866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60958 (local address 127.20.34.124:46781)
0805 22:54:21.912041 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.912047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.919153 (+ 7106us) server_negotiation.cc:407] Connection header received
0805 22:54:21.919298 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.919305 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.919388 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.919494 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.921143 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.922255 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.924353 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.925158 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.925256 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.928052 (+ 2796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.928058 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.928062 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.928095 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.933463 (+ 5368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.934274 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.934279 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.934282 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.934450 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.934837 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.934845 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.934848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.935158 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.935256 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.935663 (+ 407us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.936028 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":153,"server-negotiator.queue_time_us":43}
I20260805 22:54:21.936507 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.912032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.0.0.1:60958)
0805 22:54:21.919019 (+ 6987us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.919039 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.919183 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.919638 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.919642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.920531 (+ 889us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.920978 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.920991 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.922507 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.922512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.924187 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.924206 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.925621 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.925631 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.925836 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.926464 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.926510 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.927875 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.933614 (+ 5739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.933618 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.933621 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.934150 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.934581 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.934588 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.934591 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.934725 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.935302 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.935304 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.935405 (+ 101us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.935569 (+ 164us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.935884 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6813,"thread_start_us":7254,"threads_started":1}
I20260805 22:54:21.943343 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 29758
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.126@KRBTEST.COM for oryx/127.20.34.124@KRBTEST.COM
I20260805 22:54:21.954012 30723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.938179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60970 (local address 127.20.34.124:46781)
0805 22:54:21.938722 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.938726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.938739 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:54:21.938807 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.938810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.938913 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.939030 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.939784 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.940601 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.942121 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.942978 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.943161 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.947228 (+ 4067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.947241 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.947245 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.947282 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.950705 (+ 3423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.951724 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.951731 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.951735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.951901 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.952383 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.952389 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.952393 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.952794 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.952967 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.953450 (+ 483us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.953689 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438}
I20260805 22:54:21.954007 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.937954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.0.0.1:60970)
0805 22:54:21.938370 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:21.938386 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:21.938515 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:21.939056 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:21.939064 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:21.939469 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:21.939615 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.939624 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.940747 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.940753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.941969 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:21.941985 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.943186 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.943194 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:21.943409 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.944207 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:21.944235 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:21.947019 (+ 2784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:21.950869 (+ 3850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.950875 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.950879 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.951585 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.952034 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:21.952040 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:21.952043 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:21.952244 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:21.952940 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:21.952946 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:21.953153 (+ 207us) client_negotiation.cc:769] Sending connection context
0805 22:54:21.953336 (+ 183us) client_negotiation.cc:240] Negotiation successful
0805 22:54:21.953653 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288}
I20260805 22:54:21.955530 29671 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.34.124:46781: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f"
member_type: NON_VOTER
last_known_addr {
host: "127.20.34.124"
port: 46781
}
attrs {
promote: true
}
}
dest_uuid: "29b77d7405a843a6bf2c64c4ac6273b7"
cas_config_opid_index: 5
I20260805 22:54:21.956457 29671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } }
Aug 05 22:54:21 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.65@KRBTEST.COM
I20260805 22:54:21.958370 30718 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a3dc7fe64fee44f1a48fc07f2c85a53f (127.20.34.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:21.959295 30683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:21.963203 30718 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.34.124:46781
I20260805 22:54:21.963274 30683 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 FOLLOWER]: Refusing update from remote peer 29b77d7405a843a6bf2c64c4ac6273b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260805 22:54:21.964830 30570 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 LEARNER]: Refusing update from remote peer 29b77d7405a843a6bf2c64c4ac6273b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260805 22:54:21.965670 30501 master.cc:537] Master@127.20.34.124:46781 shutting down...
I20260805 22:54:21.978737 30718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:21.979171 30718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:21.981474 30770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:21.944802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54030 (local address 127.20.34.65:40081)
0805 22:54:21.945454 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:21.945461 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:21.945486 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:54:21.945541 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:21.945548 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:21.945856 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:21.946030 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:21.947798 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.949455 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.951442 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:21.952486 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:21.952617 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:21.959949 (+ 7332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:21.959977 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:21.959998 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:21.960051 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:21.964524 (+ 4473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.965711 (+ 1187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.965727 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.965733 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.976459 (+ 10726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:21.977325 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:21.977335 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:21.977341 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:21.978587 (+ 1246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:21.980476 (+ 1889us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:21.980659 (+ 183us) server_negotiation.cc:299] Negotiation successful
0805 22:54:21.980996 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":307,"threads_started":1}
I20260805 22:54:21.983289 29938 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:21.985060 30718 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:21.987121 30718 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260805 22:54:21.990024 30570 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a3dc7fe64fee44f1a48fc07f2c85a53f (127.20.34.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:21.995117 30612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: NON_VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: true } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:21.995458 30612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: This master's current role is: LEARNER
I20260805 22:54:21.996093 30775 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: attempting to promote NON_VOTER 2490eb41836b4fa394d342df606b919f to VOTER
I20260805 22:54:21.996953 30775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } }
I20260805 22:54:21.999545 30570 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 LEARNER]: Refusing update from remote peer 29b77d7405a843a6bf2c64c4ac6273b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260805 22:54:22.001766 30774 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260805 22:54:22.003988 30501 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:22.005120 30773 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2490eb41836b4fa394d342df606b919f (127.20.34.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:22.006248 30501 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:22.005932 30570 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 2490eb41836b4fa394d342df606b919f (127.20.34.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:22.006846 30501 tablet_replica.cc:330] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: stopping tablet replica
I20260805 22:54:22.010607 30612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:22.010877 30612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:54:22.011025 30775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:22.011374 30775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:22.011756 30775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:22.012003 30775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:22.021927 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.021316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.0.0.1:60976)
0805 22:54:22.021534 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:22.021693 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:46781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260805 22:54:22.022238 29654 consensus_peers.cc:487] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 -> Peer a3dc7fe64fee44f1a48fc07f2c85a53f (127.20.34.124:46781): Couldn't send request to peer a3dc7fe64fee44f1a48fc07f2c85a53f. Status: Network error: Client connection negotiation failed: client connection to 127.20.34.124:46781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 22:54:22.028304 30501 master.cc:552] Master@127.20.34.124:46781 shutdown complete.
I20260805 22:54:22.028412 30501 master_runner.cc:305] Clearing existing system tablet
I20260805 22:54:22.028832 30501 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:22.028949 30501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:22.032055 30501 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260805 22:54:22.033907 30783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:22.034385 30501 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:22.034657 30501 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260805 22:54:22.034765 30501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f"
format_stamp: "Formatted at 2026-08-05 22:54:21 on dist-test-slave-gmjp"
server_key: "d5e3dda470af06acea9f2b667b38c454"
server_key_iv: "b6dec750e9d7aeb314f40ee8e057e281"
server_key_version: "encryptionkey@0"
I20260805 22:54:22.040318 30501 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:22.048089 30501 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260805 22:54:22.048329 30501 log.cc:1196] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260805 22:54:22.048816 30501 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Deleting consensus metadata
I20260805 22:54:22.049084 30501 master_runner.cc:315] Copying system tablet from 127.20.34.126:45699
I20260805 22:54:22.051951 30501 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: tablet copy: Beginning tablet copy session from remote peer at address 127.20.34.126:45699
I20260805 22:54:22.068998 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.052969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36380 (local address 127.20.34.126:45699)
0805 22:54:22.053224 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:22.053230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:22.053814 (+ 584us) server_negotiation.cc:407] Connection header received
0805 22:54:22.053982 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:22.053989 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:22.054083 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:22.054199 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:22.055242 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.056466 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.058458 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.059154 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.059292 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.061860 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:22.061867 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:22.061873 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:22.061920 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:22.065771 (+ 3851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.066615 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.066621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.066625 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.066796 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.067224 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.067231 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.067237 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.067639 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:22.067805 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:22.068340 (+ 535us) server_negotiation.cc:299] Negotiation successful
0805 22:54:22.068613 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260805 22:54:22.069072 30791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.052946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:36380)
0805 22:54:22.053655 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:22.053679 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:22.053845 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:22.054256 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:22.054261 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:22.054813 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:22.055068 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.055080 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.056651 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.056657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.058259 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.058276 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.059344 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.059351 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.059541 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.060393 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:22.060421 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:22.061611 (+ 1190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:22.065933 (+ 4322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:22.065939 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:22.065944 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:22.066479 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:22.066923 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:22.066928 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:22.066932 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:22.067099 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:22.067806 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:22.067812 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:22.068025 (+ 213us) client_negotiation.cc:769] Sending connection context
0805 22:54:22.068205 (+ 180us) client_negotiation.cc:240] Negotiation successful
0805 22:54:22.068562 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":425,"threads_started":1}
I20260805 22:54:22.070055 29698 tablet_copy_service.cc:140] P 29b77d7405a843a6bf2c64c4ac6273b7: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a3dc7fe64fee44f1a48fc07f2c85a53f ({username='oryx', principal='oryx/127.20.34.124@KRBTEST.COM'} at 127.0.0.1:36380)
I20260805 22:54:22.070246 29698 tablet_copy_service.cc:161] P 29b77d7405a843a6bf2c64c4ac6273b7: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a3dc7fe64fee44f1a48fc07f2c85a53f at {username='oryx', principal='oryx/127.20.34.124@KRBTEST.COM'} at 127.0.0.1:36380: session id = a3dc7fe64fee44f1a48fc07f2c85a53f-00000000000000000000000000000000
I20260805 22:54:22.074057 29698 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 22:54:22.076243 30501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260805 22:54:22.083446 30501 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: tablet copy: Starting download of 0 data blocks...
I20260805 22:54:22.083774 30501 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: tablet copy: Starting download of 1 WAL segments...
I20260805 22:54:22.086786 30501 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 22:54:22.091308 29698 tablet_copy_service.cc:342] P 29b77d7405a843a6bf2c64c4ac6273b7: Request end of tablet copy session a3dc7fe64fee44f1a48fc07f2c85a53f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.34.124@KRBTEST.COM'} at 127.0.0.1:36380
I20260805 22:54:22.091480 29698 tablet_copy_service.cc:433] P 29b77d7405a843a6bf2c64c4ac6273b7: ending tablet copy session a3dc7fe64fee44f1a48fc07f2c85a53f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a3dc7fe64fee44f1a48fc07f2c85a53f
I20260805 22:54:22.103236 30501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:22.106225 30792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:22.109797 30793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:22.114588 30501 server_base.cc:1034] running on GCE node
W20260805 22:54:22.115031 30796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:22.115583 30501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:22.116376 30501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:22.117594 30501 hybrid_clock.cc:648] HybridClock initialized: now 1785970462117552 us; error 32 us; skew 500 ppm
I20260805 22:54:22.117851 30501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:22 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970462, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:22.119938 30501 init.cc:377] Logged in from keytab as oryx/127.20.34.124@KRBTEST.COM (short username oryx)
I20260805 22:54:22.128609 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 29758
I20260805 22:54:22.132030 30501 webserver.cc:460] Webserver started at http://127.20.34.124:38451/ using document root <none> and password file <none>
I20260805 22:54:22.132499 30501 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:22.132637 30501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:22.135994 30501 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260805 22:54:22.137830 30807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:22.138309 30501 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260805 22:54:22.138484 30501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f"
format_stamp: "Formatted at 2026-08-05 22:54:21 on dist-test-slave-gmjp"
server_key: "d5e3dda470af06acea9f2b667b38c454"
server_key_iv: "b6dec750e9d7aeb314f40ee8e057e281"
server_key_version: "encryptionkey@0"
I20260805 22:54:22.138702 30501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:22.150800 30501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:22.154548 30501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:22.165091 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:40081
--local_ip_for_outbound_sockets=127.20.34.65
--tserver_master_addrs=127.20.34.126:45699
--webserver_port=33485
--webserver_interface=127.20.34.65
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab
--principal=oryx/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617,127.20.34.124:46781 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:54:22.190469 30501 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.124:46781
I20260805 22:54:22.190663 30875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.124:46781 every 8 connection(s)
I20260805 22:54:22.191557 30501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
I20260805 22:54:22.198204 30877 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:54:22.202811 30877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Bootstrap starting.
I20260805 22:54:22.223397 30877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:54:22.224054 30877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: Bootstrap complete.
I20260805 22:54:22.225301 30877 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } }
I20260805 22:54:22.225621 30877 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a3dc7fe64fee44f1a48fc07f2c85a53f, State: Initialized, Role: LEARNER
I20260805 22:54:22.225926 30877 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } }
I20260805 22:54:22.227151 30877 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:22.226899 30881 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:22.227445 30881 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: This master's current role is: LEARNER
I20260805 22:54:22.237139 30898 catalog_manager.cc:1259] Loaded cluster ID: 11cc724874504bfb8cd1c03b8190d2aa
I20260805 22:54:22.237282 30898 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: loading cluster ID for follower catalog manager: success
I20260805 22:54:22.241209 30898 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: acquiring CA information for follower catalog manager: success
I20260805 22:54:22.243929 30898 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260805 22:54:22.569928 30837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:22.570345 30837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:22.570585 30837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:22.578907 30837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:22.579083 30837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:22.579260 30837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:54:22.589658 30837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab
--principal=oryx/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:40081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=33485
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617,127.20.34.124:46781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:22.591179 30837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:22.592870 30837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:22.607313 30904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:22.607353 30906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:22.607400 30909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:22.609622 30837 server_base.cc:1034] running on GCE node
I20260805 22:54:22.610535 30837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:22.611603 30837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:22.612870 30837 hybrid_clock.cc:648] HybridClock initialized: now 1785970462612808 us; error 48 us; skew 500 ppm
I20260805 22:54:22.613265 30837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:22.615684 30915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.609131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35360 (local address 127.20.34.124:46781)
0805 22:54:22.609677 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:22.609682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:22.609723 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:54:22.609831 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:22.609837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:22.609939 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:22.610044 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:22.610589 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.611865 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.613855 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.614692 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.614807 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.614989 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:22.615313 (+ 324us) server_negotiation.cc:299] Negotiation successful
0805 22:54:22.615423 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":282,"threads_started":1}
I20260805 22:54:22.615736 30914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.608928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.0.0.1:35360)
0805 22:54:22.609440 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:22.609464 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:22.609615 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:22.610111 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:22.610117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:22.610153 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:22.610418 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.610433 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.612020 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.612024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.613644 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.613666 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.614884 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.614891 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.615123 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.615160 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 22:54:22.615271 (+ 111us) client_negotiation.cc:240] Negotiation successful
0805 22:54:22.615423 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":216,"threads_started":1}
I20260805 22:54:22.616761 30838 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
Aug 05 22:54:22 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970462, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:22.617413 30881 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29b77d7405a843a6bf2c64c4ac6273b7. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:22.617677 30881 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: This master's current role is: LEARNER
I20260805 22:54:22.618217 30837 init.cc:377] Logged in from keytab as oryx/127.20.34.65@KRBTEST.COM (short username oryx)
I20260805 22:54:22.619839 30837 webserver.cc:460] Webserver started at http://127.20.34.65:33485/ using document root <none> and password file <none>
I20260805 22:54:22.620647 30837 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:22.620810 30837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:22.626804 30837 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260805 22:54:22.630410 30924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:22.632092 30837 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 22:54:22.632330 30837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "1b12e075295d4a3f8730b0318d0ab633"
format_stamp: "Formatted at 2026-08-05 22:54:19 on dist-test-slave-gmjp"
server_key: "8bad8e872ae45798f2df0c790b01662b"
server_key_iv: "3562d0cd9213687516f4b82cf847b86e"
server_key_version: "encryptionkey@0"
I20260805 22:54:22.633502 30837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:22.654762 30837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:22.659288 30837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:22.659621 30837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:22.660804 30837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:22.662391 30837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:22.662529 30837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:22.662674 30837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:22.662770 30837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:22.699230 30837 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:40081
I20260805 22:54:22.699324 31076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:40081 every 8 connection(s)
I20260805 22:54:22.700789 30837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:54:22.711491 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 30837
I20260805 22:54:22.711925 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 29953
Aug 05 22:54:22 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970462, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
Aug 05 22:54:22 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970462, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.125@KRBTEST.COM
I20260805 22:54:22.743167 31084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.704222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:49345 (local address 127.20.34.126:45699)
0805 22:54:22.711601 (+ 7379us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:22.711608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:22.718604 (+ 6996us) server_negotiation.cc:407] Connection header received
0805 22:54:22.719176 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:22.719182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:22.719276 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:22.719360 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:22.721730 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.722980 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.726384 (+ 3404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.727103 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.727203 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.734375 (+ 7172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:22.734384 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:22.734389 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:22.734438 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:22.738431 (+ 3993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.739845 (+ 1414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.739852 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.739855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.740028 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.740681 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.740687 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.740690 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.741078 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:22.741218 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:22.742459 (+ 1241us) server_negotiation.cc:299] Negotiation successful
0805 22:54:22.742731 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7221,"thread_start_us":7046,"threads_started":1}
I20260805 22:54:22.743188 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.704264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:38199 (local address 127.20.34.125:34617)
0805 22:54:22.715585 (+ 11321us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:22.715596 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:22.715640 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:54:22.718178 (+ 2538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:22.718186 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:22.718303 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:22.718410 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:22.721722 (+ 3312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.722980 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.726388 (+ 3408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.727089 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.727203 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.734393 (+ 7190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:22.734400 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:22.734404 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:22.734448 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:22.738413 (+ 3965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.739848 (+ 1435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.739853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.739857 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.740022 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.740681 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.740687 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.740691 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.741072 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:22.741226 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:22.742459 (+ 1233us) server_negotiation.cc:299] Negotiation successful
0805 22:54:22.742731 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7825,"thread_start_us":21430,"threads_started":1}
I20260805 22:54:22.745718 31087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.704958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.65:49345)
0805 22:54:22.718484 (+ 13526us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:22.718508 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:22.719006 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:22.719666 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:22.719670 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:22.720336 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:22.721488 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.721517 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.723216 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.723223 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.726165 (+ 2942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.726185 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.727655 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.727664 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.728134 (+ 470us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.729415 (+ 1281us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:22.729451 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:22.734021 (+ 4570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:22.738699 (+ 4678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:22.738709 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:22.738728 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:22.739668 (+ 940us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:22.740229 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:22.740234 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:22.740238 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:22.740525 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:22.741334 (+ 809us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:22.741344 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:22.741950 (+ 606us) client_negotiation.cc:769] Sending connection context
0805 22:54:22.743443 (+ 1493us) client_negotiation.cc:240] Negotiation successful
0805 22:54:22.744074 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13348,"mutex_wait_us":403,"spinlock_wait_cycles":327808,"thread_start_us":6863,"threads_started":1}
I20260805 22:54:22.745712 31086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.704874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.20.34.65:38199)
0805 22:54:22.712953 (+ 8079us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:22.713019 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:22.717684 (+ 4665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:22.719176 (+ 1492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:22.719189 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:22.720262 (+ 1073us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:22.721488 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.721517 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.723216 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.723223 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.726165 (+ 2942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.726185 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.727655 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.727664 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.728135 (+ 471us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.729415 (+ 1280us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:22.729459 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:22.734021 (+ 4562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:22.738699 (+ 4678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:22.738709 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:22.738728 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:22.739707 (+ 979us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:22.740269 (+ 562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:22.740273 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:22.740279 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:22.740547 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:22.741336 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:22.741344 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:22.741952 (+ 608us) client_negotiation.cc:769] Sending connection context
0805 22:54:22.744001 (+ 2049us) client_negotiation.cc:240] Negotiation successful
0805 22:54:22.744758 (+ 757us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7647,"mutex_wait_us":505,"spinlock_wait_cycles":96512,"thread_start_us":13607,"threads_started":1}
I20260805 22:54:22.748297 31081 heartbeater.cc:347] Connected to a master server at 127.20.34.125:34617
I20260805 22:54:22.748651 31081 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:22.749650 31081 heartbeater.cc:511] Master 127.20.34.125:34617 requested a full tablet report, sending...
I20260805 22:54:22.752346 30554 ts_manager.cc:194] Registered new tserver with Master: 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081)
I20260805 22:54:22.754662 31080 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45699
I20260805 22:54:22.754815 31080 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:22.755295 31080 heartbeater.cc:511] Master 127.20.34.126:45699 requested a full tablet report, sending...
Aug 05 22:54:22 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970462, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.124@KRBTEST.COM
I20260805 22:54:22.756850 29671 ts_manager.cc:194] Re-registered known tserver with Master: 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081)
I20260805 22:54:22.758062 29671 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:49345
Aug 05 22:54:22 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.66@KRBTEST.COM
I20260805 22:54:22.762768 30915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.713419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:50859 (local address 127.20.34.124:46781)
0805 22:54:22.713620 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:22.713626 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:22.746328 (+ 32702us) server_negotiation.cc:407] Connection header received
0805 22:54:22.746604 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:22.746633 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:22.746780 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:22.746879 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:22.748034 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.749112 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.751046 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.751714 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.751828 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.756370 (+ 4542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:22.756376 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:22.756379 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:22.756417 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:22.759662 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.760625 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.760631 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.760634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.760804 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.761323 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.761332 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.761337 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.761636 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:22.761782 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:22.762167 (+ 385us) server_negotiation.cc:299] Negotiation successful
0805 22:54:22.762404 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 22:54:22.762804 31087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.713658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.20.34.65:50859)
0805 22:54:22.746215 (+ 32557us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:22.746236 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:22.746443 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:22.747101 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:22.747104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:22.747659 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:22.747857 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.747869 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.749327 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.749332 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.750881 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:22.750897 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.752089 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.752095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:22.752316 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.753086 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:22.753112 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:22.756137 (+ 3025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:22.759839 (+ 3702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:22.759844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:22.759848 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:22.760473 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:22.760967 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:22.760972 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:22.760975 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:22.761174 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:22.761762 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:22.761765 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:22.761884 (+ 119us) client_negotiation.cc:769] Sending connection context
0805 22:54:22.762036 (+ 152us) client_negotiation.cc:240] Negotiation successful
0805 22:54:22.762405 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32436,"thread_start_us":39701,"threads_started":1}
I20260805 22:54:22.764263 31078 heartbeater.cc:347] Connected to a master server at 127.20.34.124:46781
I20260805 22:54:22.764427 31078 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:22.764926 31078 heartbeater.cc:511] Master 127.20.34.124:46781 requested a full tablet report, sending...
I20260805 22:54:22.766700 31090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:22.713569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49588 (local address 127.20.34.66:37687)
0805 22:54:22.739902 (+ 26333us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:22.739916 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:22.741305 (+ 1389us) server_negotiation.cc:407] Connection header received
0805 22:54:22.741552 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:22.741566 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:22.741945 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:22.742153 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:22.745997 (+ 3844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.748883 (+ 2886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.751560 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:22.752778 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:22.752941 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:22.759497 (+ 6556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:22.759514 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:22.759530 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:22.759570 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:22.763225 (+ 3655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.764191 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.764203 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.764209 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.764394 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:22.764960 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:22.764965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:22.764968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:22.765431 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:22.765735 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:22.766091 (+ 356us) server_negotiation.cc:299] Negotiation successful
0805 22:54:22.766294 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26051,"thread_start_us":26349,"threads_started":1}
I20260805 22:54:22.766964 30826 ts_manager.cc:194] Registered new tserver with Master: 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081)
I20260805 22:54:22.768119 30146 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:22.867761 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 29953
I20260805 22:54:22.898000 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:37687
--local_ip_for_outbound_sockets=127.20.34.66
--tserver_master_addrs=127.20.34.126:45699
--webserver_port=44559
--webserver_interface=127.20.34.66
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab
--principal=oryx/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617,127.20.34.124:46781 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:54:23.036185 30775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: NON_VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: true } } }
I20260805 22:54:23.036549 30775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:23.038182 30775 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: attempting to promote NON_VOTER a3dc7fe64fee44f1a48fc07f2c85a53f to VOTER
I20260805 22:54:23.039009 30775 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } }
I20260805 22:54:23.041620 30570 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Refusing update from remote peer 29b77d7405a843a6bf2c64c4ac6273b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260805 22:54:23.041606 30838 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 LEARNER]: Refusing update from remote peer 29b77d7405a843a6bf2c64c4ac6273b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260805 22:54:23.042338 30775 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260805 22:54:23.042835 31098 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260805 22:54:23.046308 30775 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, a3dc7fe64fee44f1a48fc07f2c85a53f (127.20.34.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:23.047194 30570 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, a3dc7fe64fee44f1a48fc07f2c85a53f (127.20.34.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:23.049571 31097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:23.049898 31097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:23.050271 30775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:23.050484 30775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:23.053996 31097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:23.054224 31097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:23.055169 30838 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, a3dc7fe64fee44f1a48fc07f2c85a53f (127.20.34.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:23.056705 31104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:23.057294 31104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:54:23.059085 30881 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:23.059326 30881 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: This master's current role is: FOLLOWER
W20260805 22:54:23.276566 31095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:23.276937 31095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:23.277151 31095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:23.284862 31095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:23.285045 31095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:23.285229 31095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:54:23.295893 31095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab
--principal=oryx/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:37687
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=44559
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617,127.20.34.124:46781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:23.297547 31095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:23.299139 31095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:23.313899 31112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:23.313944 31114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:23.313977 31119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:23.315117 31095 server_base.cc:1034] running on GCE node
I20260805 22:54:23.315810 31095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:23.317030 31095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:23.318284 31095 hybrid_clock.cc:648] HybridClock initialized: now 1785970463318220 us; error 56 us; skew 500 ppm
I20260805 22:54:23.318610 31095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:23 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970463, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:23.321900 31095 init.cc:377] Logged in from keytab as oryx/127.20.34.66@KRBTEST.COM (short username oryx)
I20260805 22:54:23.323446 31095 webserver.cc:460] Webserver started at http://127.20.34.66:44559/ using document root <none> and password file <none>
I20260805 22:54:23.324213 31095 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:23.324366 31095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:23.330798 31095 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260805 22:54:23.334033 31132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:23.335525 31095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:54:23.335697 31095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "49c3826a55054d62acd6bf05ee8d5f3f"
format_stamp: "Formatted at 2026-08-05 22:54:19 on dist-test-slave-gmjp"
server_key: "e97c1847aba7becd1be703a0047e2f4b"
server_key_iv: "9f0543461da2cd4145260195efb0fb97"
server_key_version: "encryptionkey@0"
I20260805 22:54:23.336899 31095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:23.349944 31095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:23.354326 31095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:23.354645 31095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:23.355727 31095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:23.357424 31095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:23.357559 31095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:23.357725 31095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:23.357802 31095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:23.395993 31095 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:37687
I20260805 22:54:23.396118 31294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:37687 every 8 connection(s)
I20260805 22:54:23.397780 31095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:54:23.400219 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 31095
I20260805 22:54:23.400578 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 30161
Aug 05 22:54:23 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970463, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.124@KRBTEST.COM
Aug 05 22:54:23 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970463, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
Aug 05 22:54:23 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970463, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.125@KRBTEST.COM
Aug 05 22:54:23 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970457, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.67@KRBTEST.COM
I20260805 22:54:23.452598 31307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:23.402625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:54995 (local address 127.20.34.124:46781)
0805 22:54:23.427913 (+ 25288us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:23.427922 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:23.427950 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:54:23.428030 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:23.428038 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:23.428138 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:23.428304 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:23.431451 (+ 3147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.432842 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.436361 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.437242 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.437361 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:23.443940 (+ 6579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:23.443951 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:23.443957 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:23.444015 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:23.448955 (+ 4940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:23.449918 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:23.449925 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:23.449929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:23.450105 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:23.450614 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:23.450620 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:23.450623 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:23.451030 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:23.451167 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:23.451803 (+ 636us) server_negotiation.cc:299] Negotiation successful
0805 22:54:23.452063 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25105,"thread_start_us":25861,"threads_started":1}
I20260805 22:54:23.453204 31300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:23.401607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:60583 (local address 127.20.34.125:34617)
0805 22:54:23.428462 (+ 26855us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:23.428469 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:23.428490 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:54:23.428555 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:23.428560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:23.428672 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:23.428813 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:23.431434 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.434026 (+ 2592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.437240 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.437892 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.438009 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:23.445137 (+ 7128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:23.445145 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:23.445150 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:23.445229 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:23.449717 (+ 4488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:23.450553 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:23.450558 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:23.450561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:23.450709 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:23.451198 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:23.451203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:23.451206 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:23.451557 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:23.451696 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:23.452286 (+ 590us) server_negotiation.cc:299] Negotiation successful
0805 22:54:23.452546 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26716,"thread_start_us":27345,"threads_started":1}
I20260805 22:54:23.453589 31303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:23.415562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.66:58549)
0805 22:54:23.430973 (+ 15411us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:23.431003 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:23.431148 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:23.432661 (+ 1513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:23.432666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:23.433269 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:23.433601 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:23.433611 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.434957 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.434964 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:23.436113 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:23.436130 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.437373 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.437380 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:23.437689 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:23.438605 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:23.438641 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:23.443129 (+ 4488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:23.448056 (+ 4927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:23.448068 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:23.448089 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:23.448888 (+ 799us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:23.449447 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:23.449452 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:23.449456 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:23.449745 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:23.450501 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:23.450512 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:23.451032 (+ 520us) client_negotiation.cc:769] Sending connection context
0805 22:54:23.451381 (+ 349us) client_negotiation.cc:240] Negotiation successful
0805 22:54:23.451985 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15249,"mutex_wait_us":56,"thread_start_us":10671,"threads_started":1}
I20260805 22:54:23.453859 31301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:23.401974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.20.34.66:54995)
0805 22:54:23.412003 (+ 10029us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:23.412101 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:23.418801 (+ 6700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:23.428821 (+ 10020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:23.428839 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:23.429961 (+ 1122us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:23.431209 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:23.431228 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.433200 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.433211 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:23.436092 (+ 2881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:23.436112 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.437682 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.437691 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:23.437899 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:23.438756 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:23.438783 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:23.443616 (+ 4833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:23.449168 (+ 5552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:23.449173 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:23.449177 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:23.449742 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:23.450287 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:23.450293 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:23.450297 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:23.450482 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:23.451280 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:23.451286 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:23.451483 (+ 197us) client_negotiation.cc:769] Sending connection context
0805 22:54:23.452929 (+ 1446us) client_negotiation.cc:240] Negotiation successful
0805 22:54:23.453293 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9506,"mutex_wait_us":33,"thread_start_us":11821,"threads_started":1}
I20260805 22:54:23.455065 31311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:23.415659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:58549 (local address 127.20.34.126:45699)
0805 22:54:23.432342 (+ 16683us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:23.432348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:23.432368 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:54:23.432428 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:23.432434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:23.432518 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:23.432647 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:23.433772 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.434834 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.436351 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.437055 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.438163 (+ 1108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:23.443525 (+ 5362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:23.443536 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:23.443542 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:23.443599 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:23.447843 (+ 4244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:23.449096 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:23.449105 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:23.449110 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:23.449287 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:23.449907 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:23.449912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:23.449916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:23.450330 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:23.454218 (+ 3888us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:23.454399 (+ 181us) server_negotiation.cc:299] Negotiation successful
0805 22:54:23.454676 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16538,"thread_start_us":17087,"threads_started":1}
I20260805 22:54:23.455528 31295 heartbeater.cc:347] Connected to a master server at 127.20.34.124:46781
I20260805 22:54:23.455881 31296 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45699
I20260805 22:54:23.456035 31296 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:23.456476 31308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:23.401983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.20.34.66:60583)
0805 22:54:23.425938 (+ 23955us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:23.425971 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:23.426126 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:23.429882 (+ 3756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:23.429890 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:23.430748 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:23.431196 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:23.431224 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.434210 (+ 2986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.434215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:23.437000 (+ 2785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:23.437016 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.438500 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.438508 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:23.438734 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:23.439471 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:23.439493 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:23.444861 (+ 5368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:23.449900 (+ 5039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:23.449904 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:23.449907 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:23.450406 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:23.450873 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:23.450877 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:23.450882 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:23.451051 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:23.451796 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:23.451801 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:23.451946 (+ 145us) client_negotiation.cc:769] Sending connection context
0805 22:54:23.455655 (+ 3709us) client_negotiation.cc:240] Negotiation successful
0805 22:54:23.455995 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23745,"mutex_wait_us":34,"spinlock_wait_cycles":35712,"thread_start_us":28332,"threads_started":1}
I20260805 22:54:23.457672 31297 heartbeater.cc:347] Connected to a master server at 127.20.34.125:34617
I20260805 22:54:23.457923 31297 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:23.455904 31295 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:23.459383 31295 heartbeater.cc:511] Master 127.20.34.124:46781 requested a full tablet report, sending...
I20260805 22:54:23.460247 31297 heartbeater.cc:511] Master 127.20.34.125:34617 requested a full tablet report, sending...
I20260805 22:54:23.460685 31296 heartbeater.cc:511] Master 127.20.34.126:45699 requested a full tablet report, sending...
I20260805 22:54:23.461371 31302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:23.402131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47450 (local address 127.20.34.67:40523)
0805 22:54:23.421335 (+ 19204us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:23.421348 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:23.421392 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:54:23.421490 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:23.421503 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:23.421989 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:23.422284 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:23.426001 (+ 3717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.427496 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.429646 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:23.430627 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:23.430778 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:23.445087 (+ 14309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:23.445113 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:23.445134 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:23.445194 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:23.449502 (+ 4308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:23.457533 (+ 8031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:23.457574 (+ 41us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:23.457580 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:23.457882 (+ 302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:23.458609 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:23.458616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:23.458620 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:23.459208 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:23.459655 (+ 447us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:23.460468 (+ 813us) server_negotiation.cc:299] Negotiation successful
0805 22:54:23.460864 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18953,"thread_start_us":18615,"threads_started":1}
I20260805 22:54:23.461869 30554 ts_manager.cc:194] Registered new tserver with Master: 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66:37687)
I20260805 22:54:23.461902 29671 ts_manager.cc:194] Re-registered known tserver with Master: 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66:37687)
I20260805 22:54:23.462037 30826 ts_manager.cc:194] Registered new tserver with Master: 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66:37687)
I20260805 22:54:23.463043 29671 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:58549
I20260805 22:54:23.463886 30335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:23.555023 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 30161
I20260805 22:54:23.578907 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:40523
--local_ip_for_outbound_sockets=127.20.34.67
--tserver_master_addrs=127.20.34.126:45699
--webserver_port=44315
--webserver_interface=127.20.34.67
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab
--principal=oryx/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617,127.20.34.124:46781 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:54:23.761545 31080 heartbeater.cc:503] Master 127.20.34.126:45699 was elected leader, sending a full tablet report...
W20260805 22:54:23.940856 31314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:23.941161 31314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:23.941365 31314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:23.949118 31314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:23.949293 31314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:23.949474 31314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:54:23.960367 31314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab
--principal=oryx/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:40523
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=44315
--tserver_master_addrs=127.20.34.126:45699,127.20.34.125:34617,127.20.34.124:46781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:23.961894 31314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:23.963277 31314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:23.980549 31320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:23.980543 31321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:23.980502 31323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:23.982409 31314 server_base.cc:1034] running on GCE node
I20260805 22:54:23.983081 31314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:23.984113 31314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:23.985423 31314 hybrid_clock.cc:648] HybridClock initialized: now 1785970463985372 us; error 42 us; skew 500 ppm
I20260805 22:54:23.985797 31314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:23 dist-test-slave-gmjp krb5kdc[29608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970463, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:23.989354 31314 init.cc:377] Logged in from keytab as oryx/127.20.34.67@KRBTEST.COM (short username oryx)
I20260805 22:54:23.991004 31314 webserver.cc:460] Webserver started at http://127.20.34.67:44315/ using document root <none> and password file <none>
I20260805 22:54:23.991779 31314 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:23.991954 31314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:23.998340 31314 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260805 22:54:24.001458 31332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:24.003014 31314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:24.003257 31314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "ff96b77e85fb4ab18f5626aa0335c89f"
format_stamp: "Formatted at 2026-08-05 22:54:20 on dist-test-slave-gmjp"
server_key: "f09d2c75da23437c4aaee3d024df9a96"
server_key_iv: "d622df2405839adea687c5cd6ccf0ae0"
server_key_version: "encryptionkey@0"
I20260805 22:54:24.004513 31314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:24.018934 31314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:24.024078 31314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:24.024498 31314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:24.025820 31314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:24.027470 31314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:24.027601 31314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:24.027742 31314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:24.027839 31314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:24.065797 31314 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:40523
I20260805 22:54:24.065902 31488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:40523 every 8 connection(s)
I20260805 22:54:24.067345 31314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:54:24.069252 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 31314
Aug 05 22:54:24 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970463, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.125@KRBTEST.COM
Aug 05 22:54:24 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970463, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.124@KRBTEST.COM
Aug 05 22:54:24 dist-test-slave-gmjp krb5kdc[29608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970463, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:24.105217 31497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.070851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:35513 (local address 127.20.34.125:34617)
0805 22:54:24.081700 (+ 10849us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.081710 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.081736 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:54:24.081815 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.081823 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.081928 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.084096 (+ 2168us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.085100 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.086617 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.089269 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.089977 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.090124 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.097171 (+ 7047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:24.097177 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:24.097181 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:24.097218 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:24.100800 (+ 3582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.101901 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.101907 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.101912 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.102095 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.102753 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.102759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.102762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.103142 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:24.103298 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.104496 (+ 1198us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.104748 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10674,"thread_start_us":10549,"threads_started":1}
I20260805 22:54:24.107854 31503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.072822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.20.34.67:35513)
0805 22:54:24.077983 (+ 5161us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:24.078008 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:24.081167 (+ 3159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:24.082463 (+ 1296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:24.082481 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:24.083705 (+ 1224us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:24.084866 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.084897 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.086869 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.086877 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.089055 (+ 2178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.089069 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.091586 (+ 2517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.091597 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.091900 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.092810 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:24.092849 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:24.096903 (+ 4054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:24.100971 (+ 4068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:24.100980 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:24.101000 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:24.101747 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:24.102262 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:24.102270 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:24.102276 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:24.102594 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:24.103434 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:24.103445 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:24.103973 (+ 528us) client_negotiation.cc:769] Sending connection context
0805 22:54:24.105535 (+ 1562us) client_negotiation.cc:240] Negotiation successful
0805 22:54:24.106125 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4993,"spinlock_wait_cycles":1408,"thread_start_us":11983,"threads_started":1}
I20260805 22:54:24.109825 31498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.071633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.20.34.67:38455)
0805 22:54:24.073297 (+ 1664us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:24.073354 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:24.080744 (+ 7390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:24.089316 (+ 8572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:24.089322 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:24.089812 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:24.091256 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.091273 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.093154 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.093162 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.094763 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.094775 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.095661 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.095668 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.096025 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.096796 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:24.096898 (+ 102us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:24.100775 (+ 3877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:24.105703 (+ 4928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:24.105707 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:24.105710 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:24.106201 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:24.106676 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:24.106681 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:24.106686 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:24.106907 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:24.107692 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:24.107697 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:24.107919 (+ 222us) client_negotiation.cc:769] Sending connection context
0805 22:54:24.108845 (+ 926us) client_negotiation.cc:240] Negotiation successful
0805 22:54:24.109316 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1298,"mutex_wait_us":91,"spinlock_wait_cycles":36224,"thread_start_us":4073,"threads_started":1}
I20260805 22:54:24.110037 31492 heartbeater.cc:347] Connected to a master server at 127.20.34.125:34617
I20260805 22:54:24.110497 31492 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:24.111534 31492 heartbeater.cc:511] Master 127.20.34.125:34617 requested a full tablet report, sending...
I20260805 22:54:24.113778 30554 ts_manager.cc:194] Registered new tserver with Master: ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523)
I20260805 22:54:24.114657 31499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.072407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:38455 (local address 127.20.34.124:46781)
0805 22:54:24.087798 (+ 15391us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.087805 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.087825 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:54:24.087889 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.087893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.087972 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.088102 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.091459 (+ 3357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.092961 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.094953 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.095465 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.095612 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.101033 (+ 5421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:24.101040 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:24.101046 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:24.101093 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:24.105550 (+ 4457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.106368 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.106373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.106376 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.106530 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.107053 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.107058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.107061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.107455 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:24.107612 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.110658 (+ 3046us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.110939 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15252,"thread_start_us":15133,"threads_started":1}
I20260805 22:54:24.115918 31490 heartbeater.cc:347] Connected to a master server at 127.20.34.124:46781
I20260805 22:54:24.116084 31490 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:24.116613 31490 heartbeater.cc:511] Master 127.20.34.124:46781 requested a full tablet report, sending...
I20260805 22:54:24.118427 30826 ts_manager.cc:194] Registered new tserver with Master: ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523)
I20260805 22:54:24.121896 31501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.077287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.67:54057)
0805 22:54:24.087111 (+ 9824us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:24.087139 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:24.087302 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:24.088348 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:24.088353 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:24.089081 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:24.089499 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.089520 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.094410 (+ 4890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.094419 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.096615 (+ 2196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.096638 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.100527 (+ 3889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.100537 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.100816 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.102052 (+ 1236us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:24.102083 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:24.107183 (+ 5100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:24.116032 (+ 8849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:24.116042 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:24.116049 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:24.116873 (+ 824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:24.117956 (+ 1083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:24.117965 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:24.117968 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:24.118151 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:24.120709 (+ 2558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:24.120716 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:24.120929 (+ 213us) client_negotiation.cc:769] Sending connection context
0805 22:54:24.121093 (+ 164us) client_negotiation.cc:240] Negotiation successful
0805 22:54:24.121450 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9618,"mutex_wait_us":6,"thread_start_us":3416,"threads_started":1}
I20260805 22:54:24.121949 31504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.077470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:54057 (local address 127.20.34.126:45699)
0805 22:54:24.083861 (+ 6391us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.083869 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.087235 (+ 3366us) server_negotiation.cc:407] Connection header received
0805 22:54:24.087460 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.087468 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.087577 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.087690 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.089770 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.094134 (+ 4364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.097195 (+ 3061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.098978 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.099122 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.109961 (+ 10839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:24.109969 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:24.109973 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:24.110027 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:24.114147 (+ 4120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.117036 (+ 2889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.117043 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.117047 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.117223 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.118342 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.118347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.118349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.118750 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:24.119274 (+ 524us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.121252 (+ 1978us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.121539 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6245,"thread_start_us":6120,"threads_started":1}
I20260805 22:54:24.123082 31491 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45699
I20260805 22:54:24.123232 31491 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:24.123706 31491 heartbeater.cc:511] Master 127.20.34.126:45699 requested a full tablet report, sending...
I20260805 22:54:24.124941 29671 ts_manager.cc:194] Re-registered known tserver with Master: ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523)
I20260805 22:54:24.126235 29671 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:54057
I20260805 22:54:24.136538 31510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.090258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.20.34.125:34617)
0805 22:54:24.090894 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.090903 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.111199 (+ 20296us) server_negotiation.cc:407] Connection header received
0805 22:54:24.111565 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.111574 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.111684 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.111779 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.115992 (+ 4213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.117228 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.120723 (+ 3495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.121399 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.121500 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.128023 (+ 6523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:24.128033 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:24.128041 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:24.128091 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:24.132711 (+ 4620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.133639 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.133647 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.133650 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.133853 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.134413 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.134419 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.134423 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.134839 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:24.135130 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.135815 (+ 685us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.136076 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":319,"threads_started":1}
I20260805 22:54:24.137648 31512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.090249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52356 (local address 127.20.34.126:45699)
0805 22:54:24.091273 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.091280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.117731 (+ 26451us) server_negotiation.cc:407] Connection header received
0805 22:54:24.117957 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.117963 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.118062 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.118167 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.121214 (+ 3047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.122371 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.126303 (+ 3932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.127026 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.127159 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.131339 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:24.131345 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:24.131349 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:24.131381 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:24.134511 (+ 3130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.135142 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.135147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.135149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.135284 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.135694 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.135698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.135700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.135974 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:24.136270 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.136599 (+ 329us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.136969 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":902,"thread_start_us":796,"threads_started":1}
I20260805 22:54:24.140625 31499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.117925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.20.34.124:46781)
0805 22:54:24.118113 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.118118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.120918 (+ 2800us) server_negotiation.cc:407] Connection header received
0805 22:54:24.122326 (+ 1408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.122332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.122418 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.122525 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.125377 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.126671 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.128594 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.129447 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.129570 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.133321 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:24.133331 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:24.133336 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:24.133381 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:24.136939 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.137863 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.137868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.137871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.138034 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:24.138550 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:24.138556 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:24.138560 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:24.138926 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:24.139217 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.139955 (+ 738us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.140250 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:54:24.142444 29671 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:54:24.149812 29671 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:24.184903 31532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.171547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37687 (local address 127.0.0.1:49592)
0805 22:54:24.172900 (+ 1353us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:24.172922 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:24.173300 (+ 378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:24.174190 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:24.174199 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:24.174238 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:24.175149 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.175169 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.177742 (+ 2573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.177751 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.180969 (+ 3218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.180993 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.183550 (+ 2557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.183560 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.183852 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.183919 (+ 67us) client_negotiation.cc:769] Sending connection context
0805 22:54:24.184011 (+ 92us) client_negotiation.cc:240] Negotiation successful
0805 22:54:24.184246 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1208,"mutex_wait_us":31,"thread_start_us":1060,"threads_started":1}
I20260805 22:54:24.187139 31533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.172386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49592 (local address 127.20.34.66:37687)
0805 22:54:24.172947 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.172959 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.172996 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:54:24.173518 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.173532 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.173897 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.174367 (+ 470us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:24.175410 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.177534 (+ 2124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.181245 (+ 3711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.183214 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.186000 (+ 2786us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.186352 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.186451 (+ 99us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.186705 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":866,"threads_started":1}
I20260805 22:54:24.197125 31534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.173109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:40523 (local address 127.0.0.1:47466)
0805 22:54:24.175007 (+ 1898us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:24.175030 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:24.175174 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:24.177759 (+ 2585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:24.177767 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:24.177806 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:24.178548 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.178567 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.182867 (+ 4300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.182876 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.186067 (+ 3191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.186089 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.189310 (+ 3221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.189323 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.189567 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.189601 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:54:24.189697 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 22:54:24.196623 (+ 6926us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1730,"mutex_wait_us":162,"thread_start_us":1541,"threads_started":1}
I20260805 22:54:24.197118 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.173345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47466 (local address 127.20.34.67:40523)
0805 22:54:24.174412 (+ 1067us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.174418 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.175403 (+ 985us) server_negotiation.cc:407] Connection header received
0805 22:54:24.175514 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.175526 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.175825 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.176058 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:24.180336 (+ 4278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.182638 (+ 2302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.186336 (+ 3698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.188648 (+ 2312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.188784 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.189083 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.196460 (+ 7377us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.196690 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":906,"thread_start_us":730,"threads_started":1}
I20260805 22:54:24.199736 31196 tablet_service.cc:1467] Processing CreateTablet for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc (DEFAULT_TABLE table=test-table [id=1a3c2bb0702948bb9162b3aa72f288fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:24.201457 31196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:24.201125 31402 tablet_service.cc:1467] Processing CreateTablet for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc (DEFAULT_TABLE table=test-table [id=1a3c2bb0702948bb9162b3aa72f288fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:24.202577 31532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.175007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:40980)
0805 22:54:24.185588 (+ 10581us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:24.185615 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:24.185753 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:24.188359 (+ 2606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:24.188363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:24.188395 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:24.188620 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.188636 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.190792 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.190800 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.199240 (+ 8440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.199260 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.201684 (+ 2424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.201691 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.201901 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.201941 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:54:24.202048 (+ 107us) client_negotiation.cc:240] Negotiation successful
0805 22:54:24.202205 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10433,"mutex_wait_us":5284,"thread_start_us":13629,"threads_started":1}
I20260805 22:54:24.203056 31402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:24.204996 31537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.175371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.20.34.65:40081)
0805 22:54:24.187719 (+ 12348us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.187733 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.187761 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:54:24.187858 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.187864 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.188076 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.188881 (+ 805us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:24.189175 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.190639 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.199479 (+ 8840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.201188 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.201350 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.201575 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.204381 (+ 2806us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.204595 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12148,"thread_start_us":12857,"threads_started":1}
I20260805 22:54:24.209255 30990 tablet_service.cc:1467] Processing CreateTablet for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc (DEFAULT_TABLE table=test-table [id=1a3c2bb0702948bb9162b3aa72f288fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:24.210961 30990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:24.220297 31538 tablet_bootstrap.cc:492] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Bootstrap starting.
I20260805 22:54:24.224016 31538 tablet_bootstrap.cc:654] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:24.224445 31539 tablet_bootstrap.cc:492] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Bootstrap starting.
I20260805 22:54:24.225574 31538 log.cc:824] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:24.228617 31539 tablet_bootstrap.cc:654] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:24.229632 31544 tablet_bootstrap.cc:492] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: Bootstrap starting.
I20260805 22:54:24.230079 31538 tablet_bootstrap.cc:492] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: No bootstrap required, opened a new log
I20260805 22:54:24.230104 31539 log.cc:824] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:24.230607 31538 ts_tablet_manager.cc:1397] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260805 22:54:24.233405 31539 tablet_bootstrap.cc:492] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: No bootstrap required, opened a new log
I20260805 22:54:24.233709 31539 ts_tablet_manager.cc:1397] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260805 22:54:24.233897 31544 tablet_bootstrap.cc:654] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:24.235316 31544 log.cc:824] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:24.240413 31544 tablet_bootstrap.cc:492] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: No bootstrap required, opened a new log
I20260805 22:54:24.240763 31544 ts_tablet_manager.cc:1397] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260805 22:54:24.242430 31538 raft_consensus.cc:348] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.242945 31538 raft_consensus.cc:374] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:24.243068 31538 raft_consensus.cc:729] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff96b77e85fb4ab18f5626aa0335c89f, State: Initialized, Role: FOLLOWER
I20260805 22:54:24.243687 31539 raft_consensus.cc:348] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.243790 31538 consensus_queue.cc:260] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.244053 31539 raft_consensus.cc:374] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:24.244159 31539 raft_consensus.cc:729] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49c3826a55054d62acd6bf05ee8d5f3f, State: Initialized, Role: FOLLOWER
I20260805 22:54:24.245150 31491 heartbeater.cc:503] Master 127.20.34.126:45699 was elected leader, sending a full tablet report...
I20260805 22:54:24.245865 31538 ts_tablet_manager.cc:1428] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260805 22:54:24.246737 31539 consensus_queue.cc:260] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.252898 31544 raft_consensus.cc:348] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.253566 31544 raft_consensus.cc:374] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:24.253710 31544 raft_consensus.cc:729] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b12e075295d4a3f8730b0318d0ab633, State: Initialized, Role: FOLLOWER
I20260805 22:54:24.254472 31544 consensus_queue.cc:260] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.255283 31539 ts_tablet_manager.cc:1428] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Time spent starting tablet: real 0.021s user 0.006s sys 0.014s
I20260805 22:54:24.255642 31296 heartbeater.cc:503] Master 127.20.34.126:45699 was elected leader, sending a full tablet report...
I20260805 22:54:24.258668 31544 ts_tablet_manager.cc:1428] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: Time spent starting tablet: real 0.018s user 0.012s sys 0.004s
W20260805 22:54:24.330152 31493 tablet.cc:2369] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:54:24.340361 31547 raft_consensus.cc:482] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:24.340888 31547 raft_consensus.cc:504] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.342942 31547 leader_election.cc:288] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66:37687), 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081)
I20260805 22:54:24.349555 31533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.343309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:50429 (local address 127.20.34.66:37687)
0805 22:54:24.343561 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.343567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.343589 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:54:24.343811 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.343817 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.343895 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.343990 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:24.344560 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.345338 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.347576 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.348516 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.348639 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.348740 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.349165 (+ 425us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.349298 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:54:24.349581 31537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.343864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:59723 (local address 127.20.34.65:40081)
0805 22:54:24.344134 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.344139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.344197 (+ 58us) server_negotiation.cc:407] Connection header received
0805 22:54:24.344274 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.344278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.344346 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.344447 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:24.344802 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.345611 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.347702 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.348603 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.348796 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.348876 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.349181 (+ 305us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.349305 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 22:54:24.349572 31501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.343157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37687 (local address 127.20.34.67:50429)
0805 22:54:24.343428 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:24.343451 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:24.343605 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:24.344143 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:24.344146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:24.344233 (+ 87us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:24.344404 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.344412 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.345504 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.345509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.347398 (+ 1889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.347411 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.348702 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.348708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.348987 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.349018 (+ 31us) client_negotiation.cc:769] Sending connection context
0805 22:54:24.349094 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 22:54:24.349252 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":128}
I20260805 22:54:24.349581 31498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.343614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.20.34.67:59723)
0805 22:54:24.343859 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:24.343874 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:24.343996 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:24.344466 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:24.344471 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:24.344495 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:24.344659 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.344668 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.345767 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.345775 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.347540 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:24.347558 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.348818 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.348823 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:24.349000 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.349025 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:54:24.349139 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 22:54:24.349270 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":44}
I20260805 22:54:24.350610 31230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7a6e42a5fc44f7ad6a901ad9f40edc" candidate_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" is_pre_election: true
I20260805 22:54:24.350837 31020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7a6e42a5fc44f7ad6a901ad9f40edc" candidate_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b12e075295d4a3f8730b0318d0ab633" is_pre_election: true
I20260805 22:54:24.351205 31230 raft_consensus.cc:2454] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff96b77e85fb4ab18f5626aa0335c89f in term 0.
I20260805 22:54:24.351410 31020 raft_consensus.cc:2454] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff96b77e85fb4ab18f5626aa0335c89f in term 0.
I20260805 22:54:24.351927 31337 leader_election.cc:302] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c3826a55054d62acd6bf05ee8d5f3f, ff96b77e85fb4ab18f5626aa0335c89f; no voters:
I20260805 22:54:24.352367 31547 raft_consensus.cc:2781] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:24.352532 31547 raft_consensus.cc:482] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:24.352653 31547 raft_consensus.cc:3037] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:24.354949 31547 raft_consensus.cc:504] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.355556 31547 leader_election.cc:288] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [CANDIDATE]: Term 1 election: Requested vote from peers 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66:37687), 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081)
I20260805 22:54:24.356045 31230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7a6e42a5fc44f7ad6a901ad9f40edc" candidate_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49c3826a55054d62acd6bf05ee8d5f3f"
I20260805 22:54:24.356122 31020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb7a6e42a5fc44f7ad6a901ad9f40edc" candidate_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b12e075295d4a3f8730b0318d0ab633"
I20260805 22:54:24.356313 31230 raft_consensus.cc:3037] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:24.356422 31020 raft_consensus.cc:3037] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:24.358807 31230 raft_consensus.cc:2454] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff96b77e85fb4ab18f5626aa0335c89f in term 1.
I20260805 22:54:24.358825 31020 raft_consensus.cc:2454] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff96b77e85fb4ab18f5626aa0335c89f in term 1.
I20260805 22:54:24.359336 31337 leader_election.cc:302] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c3826a55054d62acd6bf05ee8d5f3f, ff96b77e85fb4ab18f5626aa0335c89f; no voters:
I20260805 22:54:24.359712 31547 raft_consensus.cc:2781] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:24.360287 31547 raft_consensus.cc:686] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 1 LEADER]: Becoming Leader. State: Replica: ff96b77e85fb4ab18f5626aa0335c89f, State: Running, Role: LEADER
I20260805 22:54:24.361016 31547 consensus_queue.cc:237] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } }
I20260805 22:54:24.366827 29671 catalog_manager.cc:5495] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f reported cstate change: term changed from 0 to 1, leader changed from <none> to ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67). New cstate: current_term: 1 leader_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } health_report { overall_health: UNKNOWN } } }
I20260805 22:54:24.397262 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.391484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47480 (local address 127.20.34.67:40523)
0805 22:54:24.391671 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.391676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.391694 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:54:24.391793 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.391797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.391889 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.392026 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:24.392442 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.393143 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.394626 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.395037 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.395194 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:24.395765 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:24.396578 (+ 813us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:24.396746 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:24.396887 (+ 141us) server_negotiation.cc:299] Negotiation successful
0805 22:54:24.396980 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260805 22:54:24.401930 31298 tablet.cc:2369] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:54:24.407697 31020 raft_consensus.cc:1261] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 1 FOLLOWER]: Refusing update from remote peer ff96b77e85fb4ab18f5626aa0335c89f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:24.407764 31230 raft_consensus.cc:1261] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 FOLLOWER]: Refusing update from remote peer ff96b77e85fb4ab18f5626aa0335c89f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:24.408947 31551 consensus_queue.cc:1035] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [LEADER]: Connected to new peer: Peer: permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:24.409510 31547 consensus_queue.cc:1035] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:24.424443 31554 mvcc.cc:205] Tried to move back new op lower bound from 7315335022201901056 to 7315335022026944512. Current Snapshot: MvccSnapshot[applied={T|T < 7315335022201901056}]
I20260805 22:54:24.425436 31557 mvcc.cc:205] Tried to move back new op lower bound from 7315335022201901056 to 7315335022026944512. Current Snapshot: MvccSnapshot[applied={T|T < 7315335022201901056}]
I20260805 22:54:24.443672 31559 mvcc.cc:205] Tried to move back new op lower bound from 7315335022201901056 to 7315335022026944512. Current Snapshot: MvccSnapshot[applied={T|T < 7315335022201901056}]
I20260805 22:54:24.447520 29671 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:24.447861 29671 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:24.457630 29671 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 29b77d7405a843a6bf2c64c4ac6273b7: Sending DeleteTablet for 3 replicas of tablet fb7a6e42a5fc44f7ad6a901ad9f40edc
I20260805 22:54:24.459648 31196 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:24 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:49592
I20260805 22:54:24.463776 30990 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:24 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:40980
I20260805 22:54:24.464876 31402 tablet_service.cc:1514] Processing DeleteTablet for tablet fb7a6e42a5fc44f7ad6a901ad9f40edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:24 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:47466
I20260805 22:54:24.473771 31574 tablet_replica.cc:330] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: stopping tablet replica
I20260805 22:54:24.474972 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 29626
I20260805 22:54:24.476037 31574 raft_consensus.cc:2229] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:24.476246 29709 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:24.476564 31572 tablet_replica.cc:330] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: stopping tablet replica
I20260805 22:54:24.477365 31570 tablet_replica.cc:330] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: stopping tablet replica
I20260805 22:54:24.477983 31570 raft_consensus.cc:2229] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:24.478761 31570 raft_consensus.cc:2258] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:24.479637 31572 raft_consensus.cc:2229] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:54:24.480508 31572 raft_consensus.cc:2258] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:24.481446 31574 raft_consensus.cc:2258] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:24.481812 31570 ts_tablet_manager.cc:1905] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:24.483666 31574 ts_tablet_manager.cc:1905] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:24.485735 31572 ts_tablet_manager.cc:1905] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:24.491487 31574 ts_tablet_manager.cc:1918] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:24.491705 31574 log.cc:1196] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/fb7a6e42a5fc44f7ad6a901ad9f40edc
I20260805 22:54:24.492434 31574 ts_tablet_manager.cc:1939] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 49c3826a55054d62acd6bf05ee8d5f3f: Deleting consensus metadata
I20260805 22:54:24.496436 31570 ts_tablet_manager.cc:1918] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:24.496634 31570 log.cc:1196] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/fb7a6e42a5fc44f7ad6a901ad9f40edc
I20260805 22:54:24.497258 31570 ts_tablet_manager.cc:1939] T fb7a6e42a5fc44f7ad6a901ad9f40edc P 1b12e075295d4a3f8730b0318d0ab633: Deleting consensus metadata
I20260805 22:54:24.500380 31572 ts_tablet_manager.cc:1918] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:24.500600 31572 log.cc:1196] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/fb7a6e42a5fc44f7ad6a901ad9f40edc
I20260805 22:54:24.501262 31572 ts_tablet_manager.cc:1939] T fb7a6e42a5fc44f7ad6a901ad9f40edc P ff96b77e85fb4ab18f5626aa0335c89f: Deleting consensus metadata
I20260805 22:54:24.616055 29654 catalog_manager.cc:4841] TS ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523): tablet fb7a6e42a5fc44f7ad6a901ad9f40edc (table test-table [id=1a3c2bb0702948bb9162b3aa72f288fb]) successfully deleted
I20260805 22:54:24.617193 29654 catalog_manager.cc:4841] TS 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081): tablet fb7a6e42a5fc44f7ad6a901ad9f40edc (table test-table [id=1a3c2bb0702948bb9162b3aa72f288fb]) successfully deleted
I20260805 22:54:24.617424 29654 catalog_manager.cc:4841] TS 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66:37687): tablet fb7a6e42a5fc44f7ad6a901ad9f40edc (table test-table [id=1a3c2bb0702948bb9162b3aa72f288fb]) successfully deleted
I20260805 22:54:24.617928 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 29626
I20260805 22:54:25.440712 31594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.439758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.66:40297)
0805 22:54:25.440354 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.440531 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":293,"threads_started":1}
W20260805 22:54:25.441331 31296 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:45699 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
I20260805 22:54:25.444353 31595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.443281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.67:48511)
0805 22:54:25.443813 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.444003 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":274,"threads_started":1}
W20260805 22:54:25.444828 31491 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:45699 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
I20260805 22:54:25.447388 31596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.446605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.65:35761)
0805 22:54:25.447061 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.447178 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":266,"threads_started":1}
W20260805 22:54:25.447815 31080 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:45699 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
W20260805 22:54:25.707015 31592 sasl_common.cc:323] Time spent creating new SASL oryx client: real 1.036s user 0.001s sys 0.000s
W20260805 22:54:25.707113 31586 sasl_common.cc:323] Time spent creating new SASL oryx client: real 1.036s user 0.000s sys 0.000s
W20260805 22:54:25.707118 31569 sasl_common.cc:323] Time spent creating new SASL oryx client: real 1.222s user 0.000s sys 0.001s
I20260805 22:54:25.718393 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.663503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35370 (local address 127.20.34.124:46781)
0805 22:54:24.664653 (+ 1150us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.664660 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.664685 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:54:24.664751 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.664756 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.664836 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.664960 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.667096 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.667907 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.669488 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.670047 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.670194 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:25.710409 (+1040215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:25.710418 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:25.710425 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:25.710479 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:25.714216 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:25.715456 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:25.715463 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:25.715466 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:25.715627 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:25.716131 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:25.716136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:25.716140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:25.716620 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:25.716871 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:25.717700 (+ 829us) server_negotiation.cc:299] Negotiation successful
0805 22:54:25.717963 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1008,"thread_start_us":853,"threads_started":1}
I20260805 22:54:25.719029 31588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.659132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44744 (local address 127.20.34.125:34617)
0805 22:54:24.662670 (+ 3538us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.662677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.663494 (+ 817us) server_negotiation.cc:407] Connection header received
0805 22:54:24.663595 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.663601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.663692 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.663828 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.666669 (+ 2841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.667898 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.670231 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.670936 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.671076 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:25.710409 (+1039333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:25.710416 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:25.710419 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:25.710484 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:25.714563 (+ 4079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:25.715737 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:25.715745 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:25.715750 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:25.715988 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:25.716529 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:25.716534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:25.716537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:25.716920 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:25.718214 (+ 1294us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:25.718344 (+ 130us) server_negotiation.cc:299] Negotiation successful
0805 22:54:25.718641 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3387,"thread_start_us":3247,"threads_started":1}
I20260805 22:54:25.719712 31510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.462090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44728 (local address 127.20.34.125:34617)
0805 22:54:24.462280 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.462287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:24.470669 (+ 8382us) server_negotiation.cc:407] Connection header received
0805 22:54:24.471046 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:24.471056 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:24.471179 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:24.471268 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:24.480302 (+ 9034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.481494 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.483524 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:24.484222 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:24.484340 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:25.710181 (+1225841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:25.710212 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:25.710220 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:25.710285 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:25.715903 (+ 5618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:25.716676 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:25.716682 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:25.716685 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:25.716834 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:25.717238 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:25.717245 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:25.717248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:25.717521 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:25.717800 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:25.718398 (+ 598us) server_negotiation.cc:299] Negotiation successful
0805 22:54:25.718834 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":166,"server-negotiator.queue_time_us":69}
I20260805 22:54:25.732980 31499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:24.470788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35368 (local address 127.20.34.124:46781)
0805 22:54:24.471001 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:24.471008 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:25.719124 (+1248116us) server_negotiation.cc:407] Connection header received
0805 22:54:25.719294 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:25.719305 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:25.719374 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:25.719488 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:25.721329 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.722178 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.723391 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.723801 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.723908 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:25.726596 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:25.726602 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:25.726605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:25.726643 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:25.730169 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:25.730905 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:25.730910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:25.730913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:25.731077 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:25.731510 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:25.731515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:25.731517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:25.731894 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:25.732118 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:25.732511 (+ 393us) server_negotiation.cc:299] Negotiation successful
0805 22:54:25.732710 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:54:25.956657 31597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29b77d7405a843a6bf2c64c4ac6273b7)
I20260805 22:54:25.957000 31597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } }
I20260805 22:54:25.958549 31597 leader_election.cc:288] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29b77d7405a843a6bf2c64c4ac6273b7 (127.20.34.126:45699), a3dc7fe64fee44f1a48fc07f2c85a53f (127.20.34.124:46781)
I20260805 22:54:25.960088 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.958823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52518)
0805 22:54:25.959457 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.959697 (+ 240us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":309,"threads_started":1}
I20260805 22:54:25.960696 31600 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29b77d7405a843a6bf2c64c4ac6273b7)
W20260805 22:54:25.961026 30531 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
I20260805 22:54:25.961083 31600 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } }
I20260805 22:54:25.963114 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.962495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52534)
0805 22:54:25.962712 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.962888 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260805 22:54:25.963749 30531 leader_election.cc:334] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29b77d7405a843a6bf2c64c4ac6273b7 (127.20.34.126:45699): Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
I20260805 22:54:25.964193 31600 leader_election.cc:288] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29b77d7405a843a6bf2c64c4ac6273b7 (127.20.34.126:45699), 2490eb41836b4fa394d342df606b919f (127.20.34.125:34617)
I20260805 22:54:25.964267 31606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.963153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52542)
0805 22:54:25.963693 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.963859 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":263,"threads_started":1}
W20260805 22:54:25.964788 30813 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
I20260805 22:54:25.966681 31606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.966247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52552)
0805 22:54:25.966431 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.966522 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260805 22:54:25.966908 30813 leader_election.cc:334] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29b77d7405a843a6bf2c64c4ac6273b7 (127.20.34.126:45699): Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
I20260805 22:54:25.968001 31499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.959988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35382 (local address 127.20.34.124:46781)
0805 22:54:25.960295 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:25.960302 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:25.960726 (+ 424us) server_negotiation.cc:407] Connection header received
0805 22:54:25.961108 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:25.961116 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:25.961202 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:25.961338 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:25.962043 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.963186 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.965804 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.967033 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.967186 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:25.967287 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:25.967608 (+ 321us) server_negotiation.cc:299] Negotiation successful
0805 22:54:25.967762 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:54:25.968034 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.959610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:46781 (local address 127.0.0.1:35382)
0805 22:54:25.960586 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.960610 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:25.960872 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:25.961367 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:25.961373 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:25.961416 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:25.961868 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:25.961888 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.963385 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.963394 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:25.965609 (+ 2215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:25.965622 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.967229 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.967236 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:25.967427 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:25.967453 (+ 26us) client_negotiation.cc:769] Sending connection context
0805 22:54:25.967566 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 22:54:25.967716 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"thread_start_us":1063,"threads_started":1}
I20260805 22:54:25.968740 30836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2490eb41836b4fa394d342df606b919f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" is_pre_election: true
I20260805 22:54:25.969152 30836 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2490eb41836b4fa394d342df606b919f in term 1.
I20260805 22:54:25.969789 30531 leader_election.cc:302] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2490eb41836b4fa394d342df606b919f, a3dc7fe64fee44f1a48fc07f2c85a53f; no voters: 29b77d7405a843a6bf2c64c4ac6273b7
I20260805 22:54:25.970280 31597 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260805 22:54:25.970448 31597 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29b77d7405a843a6bf2c64c4ac6273b7)
I20260805 22:54:25.970631 31597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:54:25.971876 31608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.963246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:34617 (local address 127.0.0.1:44748)
0805 22:54:25.964798 (+ 1552us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.964815 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:25.964982 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:25.965535 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:25.965539 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:25.965576 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:25.966143 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:25.966155 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.967518 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.967524 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:25.969366 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:25.969387 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.971252 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.971257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:25.971394 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:25.971420 (+ 26us) client_negotiation.cc:769] Sending connection context
0805 22:54:25.971497 (+ 77us) client_negotiation.cc:240] Negotiation successful
0805 22:54:25.971595 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1395,"mutex_wait_us":2,"thread_start_us":1262,"threads_started":1}
I20260805 22:54:25.972225 31510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.963625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44748 (local address 127.20.34.125:34617)
0805 22:54:25.963881 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:25.963887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:25.964913 (+ 1026us) server_negotiation.cc:407] Connection header received
0805 22:54:25.965117 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:25.965123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:25.965235 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:25.965336 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:25.966319 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.967373 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.969525 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:25.970883 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:25.971033 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:25.971151 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:25.971566 (+ 415us) server_negotiation.cc:299] Negotiation successful
0805 22:54:25.971711 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260805 22:54:25.974007 31597 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } }
I20260805 22:54:25.972985 30570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "2490eb41836b4fa394d342df606b919f" is_pre_election: true
I20260805 22:54:25.974646 30570 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3dc7fe64fee44f1a48fc07f2c85a53f in current term 2: Already voted for candidate 2490eb41836b4fa394d342df606b919f in this term.
I20260805 22:54:25.974877 31597 leader_election.cc:288] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [CANDIDATE]: Term 2 election: Requested vote from peers 29b77d7405a843a6bf2c64c4ac6273b7 (127.20.34.126:45699), a3dc7fe64fee44f1a48fc07f2c85a53f (127.20.34.124:46781)
I20260805 22:54:25.975490 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.974976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52562)
0805 22:54:25.975276 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.975349 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210}
I20260805 22:54:25.975523 30811 leader_election.cc:302] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3dc7fe64fee44f1a48fc07f2c85a53f; no voters: 2490eb41836b4fa394d342df606b919f, 29b77d7405a843a6bf2c64c4ac6273b7
I20260805 22:54:25.976250 31600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:54:25.976605 30836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2490eb41836b4fa394d342df606b919f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f"
I20260805 22:54:25.977094 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:25.976232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52566)
0805 22:54:25.976868 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:25.976984 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524}
W20260805 22:54:25.977252 30531 leader_election.cc:334] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 29b77d7405a843a6bf2c64c4ac6273b7 (127.20.34.126:45699): Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
I20260805 22:54:25.978662 31600 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 22:54:25.981066 30836 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2490eb41836b4fa394d342df606b919f in term 2.
I20260805 22:54:25.982091 30531 leader_election.cc:302] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2490eb41836b4fa394d342df606b919f, a3dc7fe64fee44f1a48fc07f2c85a53f; no voters: 29b77d7405a843a6bf2c64c4ac6273b7
I20260805 22:54:25.982450 31597 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:54:25.982990 31597 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [term 2 LEADER]: Becoming Leader. State: Replica: 2490eb41836b4fa394d342df606b919f, State: Running, Role: LEADER
I20260805 22:54:25.983423 31597 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } }
I20260805 22:54:25.985574 31610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2490eb41836b4fa394d342df606b919f. Latest consensus state: current_term: 2 leader_uuid: "2490eb41836b4fa394d342df606b919f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:25.986073 31610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:25.986698 31612 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:25.990943 31612 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:25.991920 31612 catalog_manager.cc:1259] Loaded cluster ID: 11cc724874504bfb8cd1c03b8190d2aa
I20260805 22:54:25.992039 31612 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:25.993449 31612 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:25.994407 31612 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Loaded TSK: 0
I20260805 22:54:25.995402 31612 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:54:26.005192 30553 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:54:26.013167 30553 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:26.017664 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.017144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52586)
0805 22:54:26.017359 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.017469 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260805 22:54:26.018100 30836 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [term 2 FOLLOWER]: Refusing update from remote peer 2490eb41836b4fa394d342df606b919f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260805 22:54:26.018775 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.018372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52588)
0805 22:54:26.018542 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.018634 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260805 22:54:26.018942 31610 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260805 22:54:26.019284 30531 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f -> Peer 29b77d7405a843a6bf2c64c4ac6273b7 (127.20.34.126:45699): Couldn't send request to peer 29b77d7405a843a6bf2c64c4ac6273b7. Status: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 22:54:26.022013 31600 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2490eb41836b4fa394d342df606b919f. Latest consensus state: current_term: 2 leader_uuid: "2490eb41836b4fa394d342df606b919f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:26.022354 31600 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:54:26.023975 31597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "2490eb41836b4fa394d342df606b919f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:26.024423 31597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:26.024664 31600 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "2490eb41836b4fa394d342df606b919f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "29b77d7405a843a6bf2c64c4ac6273b7" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45699 } } peers { permanent_uuid: "2490eb41836b4fa394d342df606b919f" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 34617 } attrs { promote: false } } peers { permanent_uuid: "a3dc7fe64fee44f1a48fc07f2c85a53f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 46781 } attrs { promote: false } } }
I20260805 22:54:26.025516 31600 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3dc7fe64fee44f1a48fc07f2c85a53f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:54:26.049423 31618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.038180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40994 (local address 127.20.34.65:40081)
0805 22:54:26.038722 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.038729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.038870 (+ 141us) server_negotiation.cc:407] Connection header received
0805 22:54:26.042063 (+ 3193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.042070 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.042175 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.042314 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:26.042765 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.043909 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.046492 (+ 2583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.047706 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.048797 (+ 1091us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.048922 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.048983 (+ 61us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.049136 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":288,"threads_started":1}
I20260805 22:54:26.049713 31622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.039780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47492 (local address 127.20.34.67:40523)
0805 22:54:26.040462 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.040468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.040488 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:54:26.040573 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.040579 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.040660 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.040782 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:26.041680 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.042655 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.046386 (+ 3731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.047627 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.047777 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.047916 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.049160 (+ 1244us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.049311 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":783,"threads_started":1}
I20260805 22:54:26.050020 31598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.038094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:40994)
0805 22:54:26.038738 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.038761 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:26.039386 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:26.042338 (+ 2952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:26.042344 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:26.042373 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:26.042555 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.042565 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.044067 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.044072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.046274 (+ 2202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.046287 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.047885 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.047892 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.048090 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.048127 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 22:54:26.048218 (+ 91us) client_negotiation.cc:240] Negotiation successful
0805 22:54:26.048366 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":1}
I20260805 22:54:26.050201 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.038722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:40523 (local address 127.0.0.1:47492)
0805 22:54:26.039987 (+ 1265us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.040014 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:26.040145 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:26.040801 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:26.040805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:26.040834 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:26.041281 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.041297 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.042822 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.042829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.046163 (+ 3334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.046179 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.048073 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.048079 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.048266 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.048295 (+ 29us) client_negotiation.cc:769] Sending connection context
0805 22:54:26.048366 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 22:54:26.048477 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1135,"thread_start_us":1247,"threads_started":1}
I20260805 22:54:26.051070 30990 tablet_service.cc:1467] Processing CreateTablet for tablet 68a085c210644daa8d4f76ff8a7c3b65 (DEFAULT_TABLE table=test-table [id=63883ff3078f4ce2b86774fd6cd9bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:26.051563 30990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a085c210644daa8d4f76ff8a7c3b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:26.051622 31402 tablet_service.cc:1467] Processing CreateTablet for tablet 68a085c210644daa8d4f76ff8a7c3b65 (DEFAULT_TABLE table=test-table [id=63883ff3078f4ce2b86774fd6cd9bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:26.052210 31402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a085c210644daa8d4f76ff8a7c3b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:26.057426 31623 tablet_bootstrap.cc:492] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633: Bootstrap starting.
I20260805 22:54:26.059321 31623 tablet_bootstrap.cc:654] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:26.059916 31624 tablet_bootstrap.cc:492] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: Bootstrap starting.
I20260805 22:54:26.060629 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.038421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37687 (local address 127.0.0.1:49608)
0805 22:54:26.039194 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.039211 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:26.039347 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:26.042482 (+ 3135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:26.042489 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:26.042526 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:26.042934 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.042953 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.044721 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.044727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.047118 (+ 2391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.047134 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.059540 (+ 12406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.059556 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.059815 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.059865 (+ 50us) client_negotiation.cc:769] Sending connection context
0805 22:54:26.059988 (+ 123us) client_negotiation.cc:240] Negotiation successful
0805 22:54:26.060219 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"mutex_wait_us":3}
I20260805 22:54:26.061573 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.039201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49608 (local address 127.20.34.66:37687)
0805 22:54:26.042074 (+ 2873us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.042079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.042097 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:54:26.042174 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.042180 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.042306 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.043128 (+ 822us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:26.043344 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.044536 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.047365 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.048764 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.049011 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.049172 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.061029 (+ 11857us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.061230 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2754,"thread_start_us":2646,"threads_started":1}
I20260805 22:54:26.062029 31624 tablet_bootstrap.cc:654] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:26.062474 31623 tablet_bootstrap.cc:492] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633: No bootstrap required, opened a new log
I20260805 22:54:26.062674 31623 ts_tablet_manager.cc:1397] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260805 22:54:26.062678 31196 tablet_service.cc:1467] Processing CreateTablet for tablet 68a085c210644daa8d4f76ff8a7c3b65 (DEFAULT_TABLE table=test-table [id=63883ff3078f4ce2b86774fd6cd9bac2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:26.063235 31196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a085c210644daa8d4f76ff8a7c3b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:26.063737 31623 raft_consensus.cc:348] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.064059 31623 raft_consensus.cc:374] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:26.064205 31623 raft_consensus.cc:729] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b12e075295d4a3f8730b0318d0ab633, State: Initialized, Role: FOLLOWER
I20260805 22:54:26.064548 31623 consensus_queue.cc:260] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.066447 31624 tablet_bootstrap.cc:492] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: No bootstrap required, opened a new log
I20260805 22:54:26.066630 31624 ts_tablet_manager.cc:1397] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260805 22:54:26.067749 31624 raft_consensus.cc:348] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.068054 31624 raft_consensus.cc:374] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:26.068218 31624 raft_consensus.cc:729] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff96b77e85fb4ab18f5626aa0335c89f, State: Initialized, Role: FOLLOWER
I20260805 22:54:26.068549 31624 consensus_queue.cc:260] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.069701 31624 ts_tablet_manager.cc:1428] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260805 22:54:26.071382 31630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.070256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.67:36871)
0805 22:54:26.070886 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.071087 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":467,"threads_started":1}
I20260805 22:54:26.072762 31630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.072196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.67:37033)
0805 22:54:26.072518 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.072611 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219}
I20260805 22:54:26.075735 31492 heartbeater.cc:503] Master 127.20.34.125:34617 was elected leader, sending a full tablet report...
I20260805 22:54:26.083345 31633 tablet_bootstrap.cc:492] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: Bootstrap starting.
I20260805 22:54:26.085299 31633 tablet_bootstrap.cc:654] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:26.093468 31623 ts_tablet_manager.cc:1428] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633: Time spent starting tablet: real 0.031s user 0.010s sys 0.015s
I20260805 22:54:26.093609 31633 tablet_bootstrap.cc:492] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: No bootstrap required, opened a new log
I20260805 22:54:26.093794 31633 ts_tablet_manager.cc:1397] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260805 22:54:26.094687 31633 raft_consensus.cc:348] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.094961 31633 raft_consensus.cc:374] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:26.095050 31633 raft_consensus.cc:729] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49c3826a55054d62acd6bf05ee8d5f3f, State: Initialized, Role: FOLLOWER
I20260805 22:54:26.095299 31633 consensus_queue.cc:260] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.096940 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.094351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.65:34273)
0805 22:54:26.096259 (+ 1908us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.096498 (+ 239us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1686,"thread_start_us":1494,"threads_started":1}
I20260805 22:54:26.097724 31633 ts_tablet_manager.cc:1428] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260805 22:54:26.098260 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.097704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.65:44279)
0805 22:54:26.097996 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.098088 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260805 22:54:26.098753 31081 heartbeater.cc:503] Master 127.20.34.125:34617 was elected leader, sending a full tablet report...
I20260805 22:54:26.099558 31638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.098508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.66:33681)
0805 22:54:26.099124 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.099288 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"threads_started":1}
I20260805 22:54:26.100835 31638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.100383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.66:40647)
0805 22:54:26.100601 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.100689 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260805 22:54:26.101459 31297 heartbeater.cc:503] Master 127.20.34.125:34617 was elected leader, sending a full tablet report...
I20260805 22:54:26.104362 31637 raft_consensus.cc:482] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:26.104595 31637 raft_consensus.cc:504] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.106297 31637 leader_election.cc:288] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081), ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523)
I20260805 22:54:26.114583 31622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.107061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:51959 (local address 127.20.34.67:40523)
0805 22:54:26.107313 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.107320 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.107669 (+ 349us) server_negotiation.cc:407] Connection header received
0805 22:54:26.107816 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.107820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.107876 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.107964 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:26.108556 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.109623 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.112277 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.113528 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.113729 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.113811 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.114243 (+ 432us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.114372 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:54:26.114914 31638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.106525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.20.34.66:37061)
0805 22:54:26.106666 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.106683 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:26.106833 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:26.107510 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:26.107515 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:26.107567 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:26.107977 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.107993 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.109539 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.109543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.112057 (+ 2514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.112074 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.113839 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.113846 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.114069 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.114094 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:54:26.114187 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 22:54:26.114400 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":102}
I20260805 22:54:26.114939 31639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.106871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:40523 (local address 127.20.34.66:51959)
0805 22:54:26.107552 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.107574 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:26.107713 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:26.108010 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:26.108020 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:26.108048 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:26.108429 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.108438 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.109749 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.109760 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.112057 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:26.112074 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.113762 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.113774 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:26.114034 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.114078 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 22:54:26.114186 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:54:26.114400 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":97,"thread_start_us":359,"threads_started":1}
I20260805 22:54:26.115264 31618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.106596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:37061 (local address 127.20.34.65:40081)
0805 22:54:26.106808 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.106816 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.106836 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:54:26.107271 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.107279 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.107358 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.107455 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:26.108221 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.109415 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.112383 (+ 2968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.113617 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.113772 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.113841 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.114854 (+ 1013us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.114983 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 22:54:26.115886 31425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a085c210644daa8d4f76ff8a7c3b65" candidate_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" is_pre_election: true
I20260805 22:54:26.115926 31020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a085c210644daa8d4f76ff8a7c3b65" candidate_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b12e075295d4a3f8730b0318d0ab633" is_pre_election: true
I20260805 22:54:26.116307 31020 raft_consensus.cc:2454] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49c3826a55054d62acd6bf05ee8d5f3f in term 0.
I20260805 22:54:26.116343 31425 raft_consensus.cc:2454] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49c3826a55054d62acd6bf05ee8d5f3f in term 0.
I20260805 22:54:26.116888 31136 leader_election.cc:302] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b12e075295d4a3f8730b0318d0ab633, 49c3826a55054d62acd6bf05ee8d5f3f; no voters:
I20260805 22:54:26.117360 31637 raft_consensus.cc:2781] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:26.117514 31637 raft_consensus.cc:482] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:26.117640 31637 raft_consensus.cc:3037] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:26.119870 31637 raft_consensus.cc:504] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.120520 31637 leader_election.cc:288] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [CANDIDATE]: Term 1 election: Requested vote from peers 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081), ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523)
I20260805 22:54:26.121054 31020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a085c210644daa8d4f76ff8a7c3b65" candidate_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b12e075295d4a3f8730b0318d0ab633"
I20260805 22:54:26.121078 31425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a085c210644daa8d4f76ff8a7c3b65" candidate_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff96b77e85fb4ab18f5626aa0335c89f"
I20260805 22:54:26.121258 31020 raft_consensus.cc:3037] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:26.121279 31425 raft_consensus.cc:3037] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:26.123371 31020 raft_consensus.cc:2454] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49c3826a55054d62acd6bf05ee8d5f3f in term 1.
I20260805 22:54:26.123369 31425 raft_consensus.cc:2454] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49c3826a55054d62acd6bf05ee8d5f3f in term 1.
I20260805 22:54:26.123811 31136 leader_election.cc:302] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b12e075295d4a3f8730b0318d0ab633, 49c3826a55054d62acd6bf05ee8d5f3f; no voters:
I20260805 22:54:26.124190 31637 raft_consensus.cc:2781] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:26.124706 31637 raft_consensus.cc:686] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 LEADER]: Becoming Leader. State: Replica: 49c3826a55054d62acd6bf05ee8d5f3f, State: Running, Role: LEADER
I20260805 22:54:26.125133 31637 consensus_queue.cc:237] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } }
I20260805 22:54:26.125752 31638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.125277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.66:40013)
0805 22:54:26.125470 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.125565 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260805 22:54:26.129251 30553 catalog_manager.cc:5495] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66). New cstate: current_term: 1 leader_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49c3826a55054d62acd6bf05ee8d5f3f" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 } health_report { overall_health: UNKNOWN } } }
I20260805 22:54:26.165380 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.159803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49612 (local address 127.20.34.66:37687)
0805 22:54:26.160034 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.160040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.160060 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:54:26.160333 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.160337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.160433 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.160596 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:26.160987 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.161726 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.163049 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.163492 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.163635 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.164103 (+ 468us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:26.164713 (+ 610us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:26.164880 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.165003 (+ 123us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.165090 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 22:54:26.169679 31020 raft_consensus.cc:1261] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [term 1 FOLLOWER]: Refusing update from remote peer 49c3826a55054d62acd6bf05ee8d5f3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:26.170213 31425 raft_consensus.cc:1261] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 1 FOLLOWER]: Refusing update from remote peer 49c3826a55054d62acd6bf05ee8d5f3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:26.170495 31641 consensus_queue.cc:1035] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b12e075295d4a3f8730b0318d0ab633" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:26.171077 31637 consensus_queue.cc:1035] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff96b77e85fb4ab18f5626aa0335c89f" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 40523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:26.173520 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.172673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.65:55767)
0805 22:54:26.173171 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.173291 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368}
I20260805 22:54:26.174530 31630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.174070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.67:57775)
0805 22:54:26.174292 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.174383 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260805 22:54:26.181592 31635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.180993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.65:45899)
0805 22:54:26.181219 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.181320 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260805 22:54:26.184705 31638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.181657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.66:38937)
0805 22:54:26.184417 (+ 2760us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.184518 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2610}
I20260805 22:54:26.189146 31630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.188645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.67:38707)
0805 22:54:26.188865 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.188962 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260805 22:54:26.197714 30548 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:26.198037 30548 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:26.200656 31638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.193386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.20.34.66:43949)
0805 22:54:26.200357 (+ 6971us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.200485 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6837}
I20260805 22:54:26.206949 30548 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2490eb41836b4fa394d342df606b919f: Sending DeleteTablet for 3 replicas of tablet 68a085c210644daa8d4f76ff8a7c3b65
I20260805 22:54:26.209478 30990 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a085c210644daa8d4f76ff8a7c3b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:26 UTC) from {username='oryx', principal='oryx/127.20.34.125@KRBTEST.COM'} at 127.0.0.1:40994
I20260805 22:54:26.209514 31402 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a085c210644daa8d4f76ff8a7c3b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:26 UTC) from {username='oryx', principal='oryx/127.20.34.125@KRBTEST.COM'} at 127.0.0.1:47492
I20260805 22:54:26.210211 31196 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a085c210644daa8d4f76ff8a7c3b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:26 UTC) from {username='oryx', principal='oryx/127.20.34.125@KRBTEST.COM'} at 127.0.0.1:49608
I20260805 22:54:26.210964 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 30837
I20260805 22:54:26.217259 31399 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a085c210644daa8d4f76ff8a7c3b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:26 UTC) from {username='oryx', principal='oryx/127.20.34.125@KRBTEST.COM'} at 127.0.0.1:47492
I20260805 22:54:26.235538 31618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.212318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41010 (local address 127.20.34.65:40081)
0805 22:54:26.212478 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.212483 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.213119 (+ 636us) server_negotiation.cc:407] Connection header received
0805 22:54:26.213321 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.213330 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.213437 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.213552 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:26.215875 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.217082 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.219457 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.220217 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.220354 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.224924 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:26.224952 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:26.224981 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:26.225041 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:26.230293 (+ 5252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:26.231513 (+ 1220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:26.231524 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:26.231528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:26.231723 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:26.232316 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:26.232325 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:26.232330 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:26.232952 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:26.233310 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.234829 (+ 1519us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.235142 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260805 22:54:26.235622 31667 tablet_replica.cc:330] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: stopping tablet replica
I20260805 22:54:26.235842 31667 raft_consensus.cc:2229] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:54:26.236595 31667 raft_consensus.cc:2258] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:26.236831 31071 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:26.238180 31667 ts_tablet_manager.cc:1905] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:26.240821 31663 tablet_replica.cc:330] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: stopping tablet replica
I20260805 22:54:26.241146 31663 raft_consensus.cc:2229] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:26.241539 31663 raft_consensus.cc:2258] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:26.243826 31663 ts_tablet_manager.cc:1905] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:26.247171 31667 ts_tablet_manager.cc:1918] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:26.247346 31667 log.cc:1196] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/68a085c210644daa8d4f76ff8a7c3b65
I20260805 22:54:26.247869 31667 ts_tablet_manager.cc:1939] T 68a085c210644daa8d4f76ff8a7c3b65 P 49c3826a55054d62acd6bf05ee8d5f3f: Deleting consensus metadata
I20260805 22:54:26.249305 30531 catalog_manager.cc:4841] TS 49c3826a55054d62acd6bf05ee8d5f3f (127.20.34.66:37687): tablet 68a085c210644daa8d4f76ff8a7c3b65 (table test-table [id=63883ff3078f4ce2b86774fd6cd9bac2]) successfully deleted
I20260805 22:54:26.250689 31663 ts_tablet_manager.cc:1918] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:26.250846 31663 log.cc:1196] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/68a085c210644daa8d4f76ff8a7c3b65
I20260805 22:54:26.251333 31663 ts_tablet_manager.cc:1939] T 68a085c210644daa8d4f76ff8a7c3b65 P ff96b77e85fb4ab18f5626aa0335c89f: Deleting consensus metadata
I20260805 22:54:26.252671 30531 catalog_manager.cc:4841] TS ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523): tablet 68a085c210644daa8d4f76ff8a7c3b65 (table test-table [id=63883ff3078f4ce2b86774fd6cd9bac2]) successfully deleted
W20260805 22:54:26.253185 30531 catalog_manager.cc:4808] TS ff96b77e85fb4ab18f5626aa0335c89f (127.20.34.67:40523): delete failed for tablet 68a085c210644daa8d4f76ff8a7c3b65 because the tablet was not found. No further retry: Not found: Tablet not found: 68a085c210644daa8d4f76ff8a7c3b65
I20260805 22:54:26.339749 31662 tablet_replica.cc:330] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633: stopping tablet replica
I20260805 22:54:26.340051 31662 raft_consensus.cc:2229] T 68a085c210644daa8d4f76ff8a7c3b65 P 1b12e075295d4a3f8730b0318d0ab633 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:26.340143 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 30837
I20260805 22:54:26.367683 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.367278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:41014)
0805 22:54:26.367446 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.367522 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260805 22:54:26.367715 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 31095
W20260805 22:54:26.368345 30531 catalog_manager.cc:4584] TS 1b12e075295d4a3f8730b0318d0ab633 (127.20.34.65:40081): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 68a085c210644daa8d4f76ff8a7c3b65: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40081: connect: Connection refused (error 111)
I20260805 22:54:26.385679 31621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.368680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49628 (local address 127.20.34.66:37687)
0805 22:54:26.368913 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.368920 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.368944 (+ 24us) server_negotiation.cc:407] Connection header received
0805 22:54:26.369102 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.369109 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.369243 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.369365 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:26.370626 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.371982 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.373254 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.374061 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.374214 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.377449 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:26.377472 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:26.377503 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:26.377554 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:26.382075 (+ 4521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:26.382880 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:26.382891 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:26.382896 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:26.383118 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:26.383574 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:26.383581 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:26.383584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:26.384128 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:26.384553 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.384931 (+ 378us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.385194 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:54:26.386704 31287 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:26.429386 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.428814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:41016)
0805 22:54:26.429049 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.429200 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260805 22:54:26.430725 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.430339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:41024)
0805 22:54:26.430501 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.430585 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260805 22:54:26.499567 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.499084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:41036)
0805 22:54:26.499318 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.499410 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260805 22:54:26.500722 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.500321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:41046)
0805 22:54:26.500477 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.500607 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260805 22:54:26.502665 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.502326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52598)
0805 22:54:26.502494 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.502558 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260805 22:54:26.503585 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.503247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45699 (local address 127.0.0.1:52612)
0805 22:54:26.503394 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.503464 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:45699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260805 22:54:26.520507 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 31095
I20260805 22:54:26.553237 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 31314
I20260805 22:54:26.567696 31622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.554131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47496 (local address 127.20.34.67:40523)
0805 22:54:26.554358 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:26.554364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:26.554387 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:54:26.554614 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:26.554619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:26.554689 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:26.554801 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:26.556245 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.556993 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.558281 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:26.558717 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:26.558863 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:26.561789 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:26.561808 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:26.561827 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:26.561886 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:26.564742 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:26.565508 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:26.565516 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:26.565519 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:26.565676 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:26.566086 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:26.566092 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:26.566097 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:26.566469 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:26.566781 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:26.567101 (+ 320us) server_negotiation.cc:299] Negotiation successful
0805 22:54:26.567329 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 22:54:26.568681 31483 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:26.602208 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.601627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:41060)
0805 22:54:26.601881 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.602000 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260805 22:54:26.603282 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:26.602899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40081 (local address 127.0.0.1:41068)
0805 22:54:26.603055 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:26.603140 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260805 22:54:26.695312 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 31314
I20260805 22:54:26.728235 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 30352
I20260805 22:54:26.729529 30598 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:26.859022 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 30352
W20260805 22:54:26.888844 30811 connection.cc:535] server connection from 127.0.0.1:35382 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:54:26.889379 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 30501
I20260805 22:54:26.890530 30870 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:27.013574 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 30501
2026-08-05T22:54:27Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11362 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:54:27 dist-test-slave-gmjp krb5kdc[31679](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:54:27 dist-test-slave-gmjp krb5kdc[31679](info): set up 2 sockets
Aug 05 22:54:27 dist-test-slave-gmjp krb5kdc[31679](info): commencing operation
krb5kdc: starting...
W20260805 22:54:28.353713 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:54:28 dist-test-slave-gmjp krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:54:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.126.keytab.
Entry for principal oryx/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.126.keytab.
I20260805 22:54:28.668769 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45775
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.126.keytab
--principal=oryx/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:45775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:29.047209 31696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:29.047566 31696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:29.047670 31696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:29.055486 31696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:29.055680 31696 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 22:54:29.055800 31696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:29.055929 31696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:29.056051 31696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:29.056190 31696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:29.067803 31696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:45775
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.126.keytab
--principal=oryx/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:29.069442 31696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:29.071012 31696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:29.084800 31708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:29.084865 31705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:29.084885 31703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:29.089998 31696 server_base.cc:1034] running on GCE node
I20260805 22:54:29.091060 31696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:29.092869 31696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:29.094177 31696 hybrid_clock.cc:648] HybridClock initialized: now 1785970469094106 us; error 49 us; skew 500 ppm
I20260805 22:54:29.094591 31696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:29 dist-test-slave-gmjp krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970469, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:29.098169 31696 init.cc:377] Logged in from keytab as oryx/127.20.34.126@KRBTEST.COM (short username oryx)
I20260805 22:54:29.099929 31696 webserver.cc:460] Webserver started at http://127.20.34.126:44665/ using document root <none> and password file <none>
I20260805 22:54:29.100835 31696 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:29.100932 31696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:29.101230 31696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:29.104496 31696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "62ceb2a8836241409bf2b1466167d038"
format_stamp: "Formatted at 2026-08-05 22:54:29 on dist-test-slave-gmjp"
server_key: "8fa84ef2ae30d62f1a1a5786cb65f3e3"
server_key_iv: "b05341cda85d13c8b5bb7c38f91fb96b"
server_key_version: "encryptionkey@0"
I20260805 22:54:29.105319 31696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "62ceb2a8836241409bf2b1466167d038"
format_stamp: "Formatted at 2026-08-05 22:54:29 on dist-test-slave-gmjp"
server_key: "8fa84ef2ae30d62f1a1a5786cb65f3e3"
server_key_iv: "b05341cda85d13c8b5bb7c38f91fb96b"
server_key_version: "encryptionkey@0"
I20260805 22:54:29.111457 31696 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 22:54:29.115780 31718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:29.117455 31696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:29.117663 31696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "62ceb2a8836241409bf2b1466167d038"
format_stamp: "Formatted at 2026-08-05 22:54:29 on dist-test-slave-gmjp"
server_key: "8fa84ef2ae30d62f1a1a5786cb65f3e3"
server_key_iv: "b05341cda85d13c8b5bb7c38f91fb96b"
server_key_version: "encryptionkey@0"
I20260805 22:54:29.117926 31696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:29.135797 31696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:29.140398 31696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:29.140718 31696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:29.164912 31696 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:45775
I20260805 22:54:29.164919 31806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:45775 every 8 connection(s)
I20260805 22:54:29.166414 31696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:29.170454 31808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:29.171945 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 31696
I20260805 22:54:29.172216 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:29.173079 20617 external_mini_cluster.cc:1428] Setting key a58264d8841afc0530307dace14fd9c9
I20260805 22:54:29.187959 31808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: Bootstrap starting.
Aug 05 22:54:29 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:29.192606 31808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:29.193962 31808 log.cc:824] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:29.198102 31808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: No bootstrap required, opened a new log
I20260805 22:54:29.208922 31813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:29.175361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59806 (local address 127.20.34.126:45775)
0805 22:54:29.176421 (+ 1060us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:29.176434 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:29.176482 (+ 48us) server_negotiation.cc:407] Connection header received
0805 22:54:29.178245 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:29.178277 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:29.178758 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:29.179125 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:29.181115 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.183754 (+ 2639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.186059 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.187214 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.187436 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:29.199184 (+ 11748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:29.199204 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:29.199234 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:29.199294 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:29.203732 (+ 4438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:29.204679 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:29.204696 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:29.204706 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:29.204935 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:29.205318 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:29.205324 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:29.205329 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:29.206156 (+ 827us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:29.206490 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:29.206876 (+ 386us) server_negotiation.cc:299] Negotiation successful
0805 22:54:29.207376 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":816,"thread_start_us":528,"threads_started":1}
I20260805 22:54:29.209884 31808 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ceb2a8836241409bf2b1466167d038" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45775 } }
I20260805 22:54:29.210297 31808 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:29.210417 31808 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ceb2a8836241409bf2b1466167d038, State: Initialized, Role: FOLLOWER
I20260805 22:54:29.211130 31808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ceb2a8836241409bf2b1466167d038" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45775 } }
I20260805 22:54:29.211422 31808 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:29.211561 31808 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:29.211795 31808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:29.214315 31808 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ceb2a8836241409bf2b1466167d038" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45775 } }
I20260805 22:54:29.214809 31808 leader_election.cc:302] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62ceb2a8836241409bf2b1466167d038; no voters:
I20260805 22:54:29.215350 31808 leader_election.cc:288] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:29.215525 31815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:29.216282 31815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [term 1 LEADER]: Becoming Leader. State: Replica: 62ceb2a8836241409bf2b1466167d038, State: Running, Role: LEADER
I20260805 22:54:29.216862 31815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ceb2a8836241409bf2b1466167d038" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45775 } }
I20260805 22:54:29.217563 31808 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:29.220223 31817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62ceb2a8836241409bf2b1466167d038. Latest consensus state: current_term: 1 leader_uuid: "62ceb2a8836241409bf2b1466167d038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ceb2a8836241409bf2b1466167d038" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45775 } } }
I20260805 22:54:29.220305 31816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62ceb2a8836241409bf2b1466167d038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ceb2a8836241409bf2b1466167d038" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45775 } } }
I20260805 22:54:29.220706 31817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:29.220829 31816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:29.221843 31822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:29.230151 31822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:29.239585 31822 catalog_manager.cc:1347] Generated new cluster ID: 298fd0c7e4a24bd38af239239aa57e77
I20260805 22:54:29.239727 31822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:29.255635 31822 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:29.257130 31822 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:29.265652 31822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: Generated new TSK 0
I20260805 22:54:29.266621 31822 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab.
Entry for principal oryx/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab.
I20260805 22:54:29.351851 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45775
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab
--principal=oryx/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:29.722864 31845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:29.723204 31845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:29.723397 31845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:29.731215 31845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:29.731351 31845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:29.731523 31845 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:54:29.731648 31845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:54:29.742069 31845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab
--principal=oryx/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:29.743484 31845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:29.745007 31845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:29.759420 31854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:29.759537 31852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:29.759451 31857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:29.760406 31845 server_base.cc:1034] running on GCE node
I20260805 22:54:29.761096 31845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:29.762104 31845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:29.763381 31845 hybrid_clock.cc:648] HybridClock initialized: now 1785970469763296 us; error 48 us; skew 500 ppm
I20260805 22:54:29.763727 31845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:29 dist-test-slave-gmjp krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970469, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:29.767550 31845 init.cc:377] Logged in from keytab as oryx/127.20.34.65@KRBTEST.COM (short username oryx)
I20260805 22:54:29.769258 31845 webserver.cc:460] Webserver started at http://127.20.34.65:32891/ using document root <none> and password file <none>
I20260805 22:54:29.769991 31845 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:29.770083 31845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:29.770385 31845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:29.773655 31845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "9531c68b152c46718ea31ae8ac90f73e"
format_stamp: "Formatted at 2026-08-05 22:54:29 on dist-test-slave-gmjp"
server_key: "89ba1db53f4f775f2b2fc45554a746c2"
server_key_iv: "3d3e5456f25af5d8d9fd47907da51fd6"
server_key_version: "encryptionkey@0"
I20260805 22:54:29.774502 31845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "9531c68b152c46718ea31ae8ac90f73e"
format_stamp: "Formatted at 2026-08-05 22:54:29 on dist-test-slave-gmjp"
server_key: "89ba1db53f4f775f2b2fc45554a746c2"
server_key_iv: "3d3e5456f25af5d8d9fd47907da51fd6"
server_key_version: "encryptionkey@0"
I20260805 22:54:29.780404 31845 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260805 22:54:29.784428 31870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:29.785921 31845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:29.786115 31845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "9531c68b152c46718ea31ae8ac90f73e"
format_stamp: "Formatted at 2026-08-05 22:54:29 on dist-test-slave-gmjp"
server_key: "89ba1db53f4f775f2b2fc45554a746c2"
server_key_iv: "3d3e5456f25af5d8d9fd47907da51fd6"
server_key_version: "encryptionkey@0"
I20260805 22:54:29.786361 31845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:29.815462 31845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:29.820376 31845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:29.820683 31845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:29.823693 31845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:29.823825 31845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:29.824015 31845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:29.824100 31845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:54:29 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970469, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:29.853513 31883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:29.824611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:52773 (local address 127.20.34.126:45775)
0805 22:54:29.825151 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:29.825157 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:29.826612 (+ 1455us) server_negotiation.cc:407] Connection header received
0805 22:54:29.829940 (+ 3328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:29.829948 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:29.830053 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:29.830163 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:29.833724 (+ 3561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.834517 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.838120 (+ 3603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.838737 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.838900 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:29.844696 (+ 5796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:29.844706 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:29.844713 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:29.844775 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:29.848910 (+ 4135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:29.850345 (+ 1435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:29.850350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:29.850353 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:29.850501 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:29.851217 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:29.851222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:29.851225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:29.851553 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:29.851682 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:29.853022 (+ 1340us) server_negotiation.cc:299] Negotiation successful
0805 22:54:29.853230 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":275,"threads_started":1}
I20260805 22:54:29.855701 31885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:29.825355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45775 (local address 127.20.34.65:52773)
0805 22:54:29.826399 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:29.826461 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:29.829524 (+ 3063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:29.830894 (+ 1370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:29.830909 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:29.832109 (+ 1200us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:29.833352 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:29.833388 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.834724 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.834733 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:29.837890 (+ 3157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:29.837919 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.839313 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.839325 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:29.839638 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:29.840628 (+ 990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:29.840655 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:29.844232 (+ 3577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:29.849127 (+ 4895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:29.849142 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:29.849184 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:29.850114 (+ 930us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:29.850644 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:29.850653 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:29.850659 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:29.851041 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:29.851710 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:29.851725 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:29.852414 (+ 689us) client_negotiation.cc:769] Sending connection context
0805 22:54:29.852842 (+ 428us) client_negotiation.cc:240] Negotiation successful
0805 22:54:29.853675 (+ 833us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":370,"threads_started":1}
I20260805 22:54:29.880654 31999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:29.863789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45775 (local address 127.20.34.65:32835)
0805 22:54:29.864778 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:29.864805 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:29.865008 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:29.865428 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:29.865433 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:29.865948 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:29.866262 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:29.866273 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.867617 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.867622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:29.869616 (+ 1994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:29.869639 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.870687 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.870694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:29.870881 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:29.871718 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:29.871738 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:29.873225 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:29.877520 (+ 4295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:29.877528 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:29.877534 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:29.878166 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:29.878753 (+ 587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:29.878759 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:29.878762 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:29.878911 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:29.879505 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:29.879512 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:29.879763 (+ 251us) client_negotiation.cc:769] Sending connection context
0805 22:54:29.879937 (+ 174us) client_negotiation.cc:240] Negotiation successful
0805 22:54:29.880307 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":552,"threads_started":1}
I20260805 22:54:29.881037 31883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:29.863363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:32835 (local address 127.20.34.126:45775)
0805 22:54:29.863578 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:29.863587 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:29.864932 (+ 1345us) server_negotiation.cc:407] Connection header received
0805 22:54:29.865185 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:29.865190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:29.865269 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:29.865382 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:29.866424 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.867443 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.869778 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:29.870459 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:29.870599 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:29.873454 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:29.873463 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:29.873469 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:29.873525 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:29.877351 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:29.878410 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:29.878418 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:29.878422 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:29.878617 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:29.879060 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:29.879066 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:29.879069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:29.879375 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:29.879586 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:29.880193 (+ 607us) server_negotiation.cc:299] Negotiation successful
0805 22:54:29.880548 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:54:29.885401 31845 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:36863
I20260805 22:54:29.885424 32049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:36863 every 8 connection(s)
I20260805 22:54:29.886711 31845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:54:29.888954 32054 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45775
I20260805 22:54:29.889206 32054 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:29.889894 32054 heartbeater.cc:511] Master 127.20.34.126:45775 requested a full tablet report, sending...
I20260805 22:54:29.892220 31740 ts_manager.cc:194] Registered new tserver with Master: 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863)
I20260805 22:54:29.893744 31740 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:52773
I20260805 22:54:29.895340 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 31845
I20260805 22:54:29.895574 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:54:29.896306 20617 external_mini_cluster.cc:1428] Setting key a390379f15655d750105ee7f7e8d6ce8
WARNING: no policy specified for oryx/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab.
Entry for principal oryx/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab.
I20260805 22:54:29.964579 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45775
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab
--principal=oryx/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:30.329722 32060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:30.330065 32060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:30.330166 32060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:30.337481 32060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:30.337604 32060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:30.337694 32060 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:54:30.337777 32060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:54:30.347990 32060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab
--principal=oryx/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:30.349360 32060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:30.350772 32060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:30.364814 32067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:30.364842 32069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:30.364933 32071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:30.365893 32060 server_base.cc:1034] running on GCE node
I20260805 22:54:30.366612 32060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:30.367671 32060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:30.368960 32060 hybrid_clock.cc:648] HybridClock initialized: now 1785970470368865 us; error 67 us; skew 500 ppm
I20260805 22:54:30.369315 32060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:30 dist-test-slave-gmjp krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970470, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:30.372872 32060 init.cc:377] Logged in from keytab as oryx/127.20.34.66@KRBTEST.COM (short username oryx)
I20260805 22:54:30.374404 32060 webserver.cc:460] Webserver started at http://127.20.34.66:37127/ using document root <none> and password file <none>
I20260805 22:54:30.375138 32060 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:30.375231 32060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:30.375558 32060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:30.378803 32060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "fa1314fe48a04f8fb891d67d4c9b98ff"
format_stamp: "Formatted at 2026-08-05 22:54:30 on dist-test-slave-gmjp"
server_key: "b80515ec07a2c1d3cd54b875d271bcdc"
server_key_iv: "5b57cb87d7f1d6260700f1951e75726d"
server_key_version: "encryptionkey@0"
I20260805 22:54:30.379599 32060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "fa1314fe48a04f8fb891d67d4c9b98ff"
format_stamp: "Formatted at 2026-08-05 22:54:30 on dist-test-slave-gmjp"
server_key: "b80515ec07a2c1d3cd54b875d271bcdc"
server_key_iv: "5b57cb87d7f1d6260700f1951e75726d"
server_key_version: "encryptionkey@0"
I20260805 22:54:30.385382 32060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260805 22:54:30.389149 32083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:30.390689 32060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:54:30.390897 32060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "fa1314fe48a04f8fb891d67d4c9b98ff"
format_stamp: "Formatted at 2026-08-05 22:54:30 on dist-test-slave-gmjp"
server_key: "b80515ec07a2c1d3cd54b875d271bcdc"
server_key_iv: "5b57cb87d7f1d6260700f1951e75726d"
server_key_version: "encryptionkey@0"
I20260805 22:54:30.391194 32060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:30.411260 32060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:30.415657 32060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:30.416013 32060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:30.419023 32060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:30.419143 32060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:30.419319 32060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:30.419401 32060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:54:30 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970470, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:30.447781 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:30.419908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:51909 (local address 127.20.34.126:45775)
0805 22:54:30.420405 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:30.420412 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:30.421913 (+ 1501us) server_negotiation.cc:407] Connection header received
0805 22:54:30.425312 (+ 3399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:30.425322 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:30.425436 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:30.425575 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:30.428659 (+ 3084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:30.429760 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:30.433314 (+ 3554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:30.433936 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:30.434090 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:30.438997 (+ 4907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:30.439008 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:30.439016 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:30.439081 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:30.443078 (+ 3997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:30.444586 (+ 1508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:30.444595 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:30.444601 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:30.444806 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:30.445526 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:30.445533 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:30.445539 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:30.445928 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:30.446139 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:30.447119 (+ 980us) server_negotiation.cc:299] Negotiation successful
0805 22:54:30.447373 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":260,"threads_started":1}
I20260805 22:54:30.449267 32097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:30.420664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45775 (local address 127.20.34.66:51909)
0805 22:54:30.421662 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:30.421730 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:30.424865 (+ 3135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:30.426150 (+ 1285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:30.426165 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:30.427179 (+ 1014us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:30.428392 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:30.428420 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:30.430013 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:30.430027 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:30.433023 (+ 2996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:30.433044 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:30.434385 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:30.434391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:30.434588 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:30.435452 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:30.435483 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:30.438632 (+ 3149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:30.443335 (+ 4703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:30.443352 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:30.443387 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:30.444396 (+ 1009us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:30.444941 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:30.444946 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:30.444948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:30.445327 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:30.446222 (+ 895us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:30.446230 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:30.446657 (+ 427us) client_negotiation.cc:769] Sending connection context
0805 22:54:30.447023 (+ 366us) client_negotiation.cc:240] Negotiation successful
0805 22:54:30.447638 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":367,"threads_started":1}
I20260805 22:54:30.469789 32060 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:37907
I20260805 22:54:30.469806 32261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:37907 every 8 connection(s)
I20260805 22:54:30.471555 32060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:54:30.474205 32263 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45775
I20260805 22:54:30.474514 32263 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:30.474601 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:30.455112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:44313 (local address 127.20.34.126:45775)
0805 22:54:30.455295 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:30.455299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:30.456182 (+ 883us) server_negotiation.cc:407] Connection header received
0805 22:54:30.456613 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:30.456619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:30.456696 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:30.456825 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:30.458571 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:30.459922 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:30.462469 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:30.463296 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:30.463431 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:30.467098 (+ 3667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:30.467110 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:30.467118 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:30.467171 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:30.470981 (+ 3810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:30.471809 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:30.471815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:30.471819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:30.471996 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:30.472636 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:30.472641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:30.472645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:30.473172 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:30.473292 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:30.474007 (+ 715us) server_negotiation.cc:299] Negotiation successful
0805 22:54:30.474255 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260805 22:54:30.474756 32199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:30.455193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45775 (local address 127.20.34.66:44313)
0805 22:54:30.456014 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:30.456044 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:30.456449 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:30.456887 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:30.456895 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:30.457721 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:30.458300 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:30.458318 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:30.460189 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:30.460196 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:30.462230 (+ 2034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:30.462255 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:30.463889 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:30.463901 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:30.464216 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:30.465166 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:30.465202 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:30.466751 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:30.471139 (+ 4388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:30.471143 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:30.471146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:30.471589 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:30.472207 (+ 618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:30.472216 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:30.472221 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:30.472438 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:30.473411 (+ 973us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:30.473416 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:30.473654 (+ 238us) client_negotiation.cc:769] Sending connection context
0805 22:54:30.473787 (+ 133us) client_negotiation.cc:240] Negotiation successful
0805 22:54:30.474240 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":389,"threads_started":1}
I20260805 22:54:30.475512 32263 heartbeater.cc:511] Master 127.20.34.126:45775 requested a full tablet report, sending...
I20260805 22:54:30.477068 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 32060
I20260805 22:54:30.477274 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:54:30.477288 31740 ts_manager.cc:194] Registered new tserver with Master: fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907)
I20260805 22:54:30.477874 20617 external_mini_cluster.cc:1428] Setting key 922f3fc62d88ebf9e77e925ff85b96f6
I20260805 22:54:30.478384 31740 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:51909
WARNING: no policy specified for oryx/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab.
Entry for principal oryx/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab.
I20260805 22:54:30.543741 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45775
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab
--principal=oryx/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:54:30.897050 32054 heartbeater.cc:503] Master 127.20.34.126:45775 was elected leader, sending a full tablet report...
W20260805 22:54:30.919667 32267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:30.919968 32267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:30.920186 32267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:30.928009 32267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:30.928166 32267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:30.928344 32267 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 22:54:30.928494 32267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:54:30.938712 32267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab
--principal=oryx/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.34.126:45775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:30.940207 32267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:30.941712 32267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:30.955979 32280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:30.955950 32275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:30.956138 32274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:30.957041 32267 server_base.cc:1034] running on GCE node
I20260805 22:54:30.957759 32267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:30.958894 32267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:30.960130 32267 hybrid_clock.cc:648] HybridClock initialized: now 1785970470960065 us; error 48 us; skew 500 ppm
I20260805 22:54:30.960508 32267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:30 dist-test-slave-gmjp krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970470, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:30.966779 32267 init.cc:377] Logged in from keytab as oryx/127.20.34.67@KRBTEST.COM (short username oryx)
I20260805 22:54:30.968413 32267 webserver.cc:460] Webserver started at http://127.20.34.67:33043/ using document root <none> and password file <none>
I20260805 22:54:30.969108 32267 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:30.969198 32267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:30.969491 32267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:30.972697 32267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "92866fbb1dce4dc3bb0418f76985a488"
format_stamp: "Formatted at 2026-08-05 22:54:30 on dist-test-slave-gmjp"
server_key: "b9f7cb4dc10ae571b83e977a4a3d1c5b"
server_key_iv: "b0767c39a81d8cc2ed06079826d76fbd"
server_key_version: "encryptionkey@0"
I20260805 22:54:30.973556 32267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "92866fbb1dce4dc3bb0418f76985a488"
format_stamp: "Formatted at 2026-08-05 22:54:30 on dist-test-slave-gmjp"
server_key: "b9f7cb4dc10ae571b83e977a4a3d1c5b"
server_key_iv: "b0767c39a81d8cc2ed06079826d76fbd"
server_key_version: "encryptionkey@0"
I20260805 22:54:30.979386 32267 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:54:30.983227 32287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:30.984740 32267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:30.984925 32267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "92866fbb1dce4dc3bb0418f76985a488"
format_stamp: "Formatted at 2026-08-05 22:54:30 on dist-test-slave-gmjp"
server_key: "b9f7cb4dc10ae571b83e977a4a3d1c5b"
server_key_iv: "b0767c39a81d8cc2ed06079826d76fbd"
server_key_version: "encryptionkey@0"
I20260805 22:54:30.985191 32267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:30.997816 32267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:31.002511 32267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:31.002755 32267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:31.005667 32267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:31.005782 32267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:31.005968 32267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:31.006035 32267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 22:54:31 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970470, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:31.035640 32301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:31.006923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45775 (local address 127.20.34.67:35735)
0805 22:54:31.007803 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:31.007862 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:31.009960 (+ 2098us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:31.010859 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:31.010868 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:31.011805 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:31.012913 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:31.012940 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.014820 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.014828 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:31.017310 (+ 2482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:31.017338 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.018670 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.018676 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:31.018872 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:31.019747 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:31.019793 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:31.023865 (+ 4072us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:31.028684 (+ 4819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:31.028696 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:31.028718 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:31.029594 (+ 876us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:31.030249 (+ 655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:31.030258 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:31.030270 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:31.030649 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:31.031423 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:31.031438 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:31.032171 (+ 733us) client_negotiation.cc:769] Sending connection context
0805 22:54:31.032621 (+ 450us) client_negotiation.cc:240] Negotiation successful
0805 22:54:31.033431 (+ 810us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":389,"threads_started":1}
I20260805 22:54:31.037369 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:31.006174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:35735 (local address 127.20.34.126:45775)
0805 22:54:31.007078 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:31.007083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:31.008004 (+ 921us) server_negotiation.cc:407] Connection header received
0805 22:54:31.010303 (+ 2299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:31.010309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:31.010436 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:31.010569 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:31.013244 (+ 2675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.014618 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.017502 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.018399 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.018585 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:31.024360 (+ 5775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:31.024367 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:31.024370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:31.024414 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:31.028401 (+ 3987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:31.029795 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:31.029804 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:31.029811 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:31.030045 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:31.030846 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:31.030854 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:31.030859 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:31.031247 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:31.031451 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:31.036432 (+ 4981us) server_negotiation.cc:299] Negotiation successful
0805 22:54:31.036796 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793,"thread_start_us":663,"threads_started":1}
I20260805 22:54:31.054993 32267 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:46597
I20260805 22:54:31.055013 32453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:46597 every 8 connection(s)
I20260805 22:54:31.056591 32267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:54:31.056886 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 32267
I20260805 22:54:31.057087 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:54:31.057811 20617 external_mini_cluster.cc:1428] Setting key 93dde167eb20cf5b9214bd5060173671
I20260805 22:54:31.059401 32454 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45775
I20260805 22:54:31.060078 32442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:31.045466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45775 (local address 127.20.34.67:53557)
0805 22:54:31.046217 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:31.046244 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:31.046559 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:31.046974 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:31.046979 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:31.047495 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:31.047820 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:31.047831 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.049209 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.049215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:31.050254 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:31.050268 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.051113 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.051121 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:31.051308 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:31.052147 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:31.052224 (+ 77us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:31.053327 (+ 1103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:31.056707 (+ 3380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:31.056714 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:31.056718 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:31.057182 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:31.057828 (+ 646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:31.057833 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:31.057836 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:31.058008 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:31.058762 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:31.058768 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:31.058969 (+ 201us) client_negotiation.cc:769] Sending connection context
0805 22:54:31.059128 (+ 159us) client_negotiation.cc:240] Negotiation successful
0805 22:54:31.059559 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":429,"threads_started":1}
I20260805 22:54:31.060556 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:31.045407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:53557 (local address 127.20.34.126:45775)
0805 22:54:31.045621 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:31.045628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:31.046367 (+ 739us) server_negotiation.cc:407] Connection header received
0805 22:54:31.046740 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:31.046745 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:31.046818 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:31.046935 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:31.047993 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.049060 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.050423 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.050924 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.051054 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:31.053549 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:31.053554 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:31.053557 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:31.053593 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:31.056562 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:31.057480 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:31.057486 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:31.057489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:31.057665 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:31.058214 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:31.058218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:31.058221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:31.058632 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:31.058804 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:31.059868 (+ 1064us) server_negotiation.cc:299] Negotiation successful
0805 22:54:31.060124 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:54:31.059715 32454 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:31.062016 32454 heartbeater.cc:511] Master 127.20.34.126:45775 requested a full tablet report, sending...
I20260805 22:54:31.063822 31739 ts_manager.cc:194] Registered new tserver with Master: 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597)
I20260805 22:54:31.064934 31739 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:35735
I20260805 22:54:31.075592 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 22:54:31 dist-test-slave-gmjp krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970471, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 22:54:31 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:31 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:31.481523 32263 heartbeater.cc:503] Master 127.20.34.126:45775 was elected leader, sending a full tablet report...
I20260805 22:54:32.067550 32454 heartbeater.cc:503] Master 127.20.34.126:45775 was elected leader, sending a full tablet report...
W20260805 22:54:32.285490 32466 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.146s user 0.000s sys 0.023s
W20260805 22:54:32.286998 32300 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:31.133480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59816 (local address 127.20.34.126:45775)
0805 22:54:31.133735 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:31.133742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:31.133965 (+ 223us) server_negotiation.cc:407] Connection header received
0805 22:54:31.134215 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:31.134219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:31.134289 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:31.134411 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:31.135823 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.136635 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.137893 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:31.138317 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:31.138478 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.286638 (+1148160us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59816: BlockingRecv error: recv got EOF from 127.0.0.1:59816 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 05 22:54:32 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970471, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:32.307053 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.291968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57846 (local address 127.20.34.126:45775)
0805 22:54:32.292191 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.292199 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.292673 (+ 474us) server_negotiation.cc:407] Connection header received
0805 22:54:32.292832 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.292837 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.292923 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.293016 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:32.294363 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.295142 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.296552 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.297013 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.297118 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.301406 (+ 4288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:32.301413 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:32.301416 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:32.301460 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:32.304422 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:32.305120 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:32.305125 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:32.305127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:32.305267 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:32.305641 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:32.305645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:32.305647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:32.305960 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:32.306185 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.306469 (+ 284us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.306666 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 22:54:32.311695 31739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57846:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:54:32.319439 31739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:32.346668 32482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.333213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37268 (local address 127.20.34.66:37907)
0805 22:54:32.337509 (+ 4296us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.337521 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.337554 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:54:32.337685 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.337697 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.338042 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.339408 (+ 1366us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:32.339659 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.341296 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.344277 (+ 2981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.345446 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.345615 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.345850 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.346141 (+ 291us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.346317 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4058,"thread_start_us":3904,"threads_started":1}
I20260805 22:54:32.346828 32481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.333009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37907 (local address 127.0.0.1:37268)
0805 22:54:32.334500 (+ 1491us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.334550 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.334735 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.338362 (+ 3627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.338375 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.338436 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:32.339139 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.339154 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.341438 (+ 2284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.341444 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.344057 (+ 2613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.344073 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.345676 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.345682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.345874 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.345936 (+ 62us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.346092 (+ 156us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.346317 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1216,"mutex_wait_us":33,"thread_start_us":1063,"threads_started":1}
I20260805 22:54:32.347414 32484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.333211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:36863 (local address 127.0.0.1:42808)
0805 22:54:32.335856 (+ 2645us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.336751 (+ 895us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.338119 (+ 1368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.338773 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.338777 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.338804 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:32.339509 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.339522 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.342020 (+ 2498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.342031 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.344349 (+ 2318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.344359 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.346545 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.346552 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.346730 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.346766 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.346877 (+ 111us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.347018 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2493,"mutex_wait_us":3,"thread_start_us":2354,"threads_started":1}
I20260805 22:54:32.347908 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.333932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42808 (local address 127.20.34.65:36863)
0805 22:54:32.335370 (+ 1438us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.335393 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.336925 (+ 1532us) server_negotiation.cc:407] Connection header received
0805 22:54:32.338342 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.338352 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.338589 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.338793 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:32.339714 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.341852 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.344510 (+ 2658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.346001 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.346146 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.346382 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.347451 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.347628 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1256,"thread_start_us":1093,"threads_started":1}
I20260805 22:54:32.349025 32486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.335590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:46597 (local address 127.0.0.1:57292)
0805 22:54:32.339412 (+ 3822us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.339439 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.339613 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.340509 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.340514 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.340581 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:32.340931 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.340942 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.342859 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.342867 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.344591 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.344606 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.348151 (+ 3545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.348161 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.348388 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.348422 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.348525 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.348656 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3638,"mutex_wait_us":4,"thread_start_us":3457,"threads_started":1}
I20260805 22:54:32.349064 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.336315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57292 (local address 127.20.34.67:46597)
0805 22:54:32.337808 (+ 1493us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.337816 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.339536 (+ 1720us) server_negotiation.cc:407] Connection header received
0805 22:54:32.339792 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.339800 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.340046 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.340285 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:32.341203 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.342704 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.344761 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.347635 (+ 2874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.347774 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.347956 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.348603 (+ 647us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.348772 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1322,"thread_start_us":1181,"threads_started":1}
I20260805 22:54:32.351321 32156 tablet_service.cc:1467] Processing CreateTablet for tablet d9c2c705a3bc4b0aa6a118c9d8645301 (DEFAULT_TABLE table=test-table [id=690a4dcead8f40cf87484c4fd0c71f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:32.351333 31949 tablet_service.cc:1467] Processing CreateTablet for tablet d9c2c705a3bc4b0aa6a118c9d8645301 (DEFAULT_TABLE table=test-table [id=690a4dcead8f40cf87484c4fd0c71f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:32.352890 32156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c2c705a3bc4b0aa6a118c9d8645301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:32.352893 31949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c2c705a3bc4b0aa6a118c9d8645301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:32.353055 32355 tablet_service.cc:1467] Processing CreateTablet for tablet d9c2c705a3bc4b0aa6a118c9d8645301 (DEFAULT_TABLE table=test-table [id=690a4dcead8f40cf87484c4fd0c71f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:32.354430 32355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9c2c705a3bc4b0aa6a118c9d8645301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:32.365412 32488 tablet_bootstrap.cc:492] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Bootstrap starting.
I20260805 22:54:32.368661 32490 tablet_bootstrap.cc:492] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: Bootstrap starting.
I20260805 22:54:32.369290 32488 tablet_bootstrap.cc:654] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.370597 32492 tablet_bootstrap.cc:492] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: Bootstrap starting.
I20260805 22:54:32.371734 32488 log.cc:824] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:32.373037 32490 tablet_bootstrap.cc:654] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.374168 32492 tablet_bootstrap.cc:654] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.374775 32490 log.cc:824] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:32.375345 32492 log.cc:824] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:32.378320 32492 tablet_bootstrap.cc:492] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: No bootstrap required, opened a new log
I20260805 22:54:32.378398 32488 tablet_bootstrap.cc:492] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: No bootstrap required, opened a new log
I20260805 22:54:32.378667 32492 ts_tablet_manager.cc:1397] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260805 22:54:32.378726 32488 ts_tablet_manager.cc:1397] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260805 22:54:32.378829 32490 tablet_bootstrap.cc:492] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: No bootstrap required, opened a new log
I20260805 22:54:32.379119 32490 ts_tablet_manager.cc:1397] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260805 22:54:32.386605 32492 raft_consensus.cc:348] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.387094 32492 raft_consensus.cc:374] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.387198 32492 raft_consensus.cc:729] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92866fbb1dce4dc3bb0418f76985a488, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.387976 32492 consensus_queue.cc:260] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.390395 32490 raft_consensus.cc:348] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.390408 32488 raft_consensus.cc:348] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.390888 32490 raft_consensus.cc:374] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.390914 32488 raft_consensus.cc:374] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.391009 32490 raft_consensus.cc:729] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9531c68b152c46718ea31ae8ac90f73e, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.391001 32488 raft_consensus.cc:729] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1314fe48a04f8fb891d67d4c9b98ff, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.391680 32488 consensus_queue.cc:260] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.392066 32490 consensus_queue.cc:260] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.393471 32492 ts_tablet_manager.cc:1428] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260805 22:54:32.400446 32488 ts_tablet_manager.cc:1428] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent starting tablet: real 0.022s user 0.017s sys 0.005s
I20260805 22:54:32.400976 32490 ts_tablet_manager.cc:1428] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: Time spent starting tablet: real 0.022s user 0.017s sys 0.004s
I20260805 22:54:32.446436 32497 raft_consensus.cc:482] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:32.446769 32497 raft_consensus.cc:504] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.448679 32497 leader_election.cc:288] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597)
I20260805 22:54:32.453939 32498 raft_consensus.cc:482] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:32.454289 32498 raft_consensus.cc:504] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.458957 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.449316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:50753 (local address 127.20.34.67:46597)
0805 22:54:32.449530 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.449538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.450410 (+ 872us) server_negotiation.cc:407] Connection header received
0805 22:54:32.450653 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.450658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.450730 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.450839 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:32.451758 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.452913 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.456104 (+ 3191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.457472 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.457619 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.457697 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.458522 (+ 825us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.458676 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:54:32.458999 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.449295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:41641 (local address 127.20.34.65:36863)
0805 22:54:32.449538 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.449543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.450501 (+ 958us) server_negotiation.cc:407] Connection header received
0805 22:54:32.450639 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.450644 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.450730 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.450867 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:32.451759 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.452913 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.456114 (+ 3201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.457472 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.457617 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.457767 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.458522 (+ 755us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.458676 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260805 22:54:32.459789 32499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.449241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:36863 (local address 127.20.34.66:41641)
0805 22:54:32.450388 (+ 1147us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.450404 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.450506 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.450902 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.450907 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.450951 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:32.451582 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.451593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.453060 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.453064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.455888 (+ 2824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.455905 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.457982 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.457988 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.458254 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.458313 (+ 59us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.459174 (+ 861us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.459337 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1003,"mutex_wait_us":223,"spinlock_wait_cycles":63872,"thread_start_us":515,"threads_started":1}
I20260805 22:54:32.459954 32502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.449220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:46597 (local address 127.20.34.66:50753)
0805 22:54:32.450274 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.450296 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.450486 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.450902 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.450907 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.450940 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:32.451578 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.451593 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.453058 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.453064 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.455896 (+ 2832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.455905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.457963 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.457971 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.458267 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.458318 (+ 51us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.459405 (+ 1087us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.459553 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"mutex_wait_us":264,"thread_start_us":565,"threads_started":1}
I20260805 22:54:32.460973 31985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c2c705a3bc4b0aa6a118c9d8645301" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e" is_pre_election: true
I20260805 22:54:32.461452 32383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c2c705a3bc4b0aa6a118c9d8645301" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92866fbb1dce4dc3bb0418f76985a488" is_pre_election: true
I20260805 22:54:32.461599 31985 raft_consensus.cc:2454] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 0.
I20260805 22:54:32.462100 32383 raft_consensus.cc:2454] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 0.
I20260805 22:54:32.462939 32084 leader_election.cc:302] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 92866fbb1dce4dc3bb0418f76985a488, 9531c68b152c46718ea31ae8ac90f73e, fa1314fe48a04f8fb891d67d4c9b98ff; no voters:
I20260805 22:54:32.463404 32497 raft_consensus.cc:2781] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:32.463577 32497 raft_consensus.cc:482] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:32.463687 32497 raft_consensus.cc:3037] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.464329 32498 leader_election.cc:288] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907), 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597)
I20260805 22:54:32.467188 32497 raft_consensus.cc:504] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.468572 32383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c2c705a3bc4b0aa6a118c9d8645301" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92866fbb1dce4dc3bb0418f76985a488"
I20260805 22:54:32.468848 32383 raft_consensus.cc:3037] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.468971 31985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c2c705a3bc4b0aa6a118c9d8645301" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e"
I20260805 22:54:32.469233 31985 raft_consensus.cc:3037] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.472492 32383 raft_consensus.cc:2454] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 1.
I20260805 22:54:32.473924 32482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.456791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:37069 (local address 127.20.34.66:37907)
0805 22:54:32.457032 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.457038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.465752 (+ 8714us) server_negotiation.cc:407] Connection header received
0805 22:54:32.466055 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.466061 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.466135 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.466194 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:32.467139 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.468231 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.471397 (+ 3166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.472684 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.472830 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.472909 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.473541 (+ 632us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.473696 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 22:54:32.474385 32504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.456244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37907 (local address 127.20.34.65:37069)
0805 22:54:32.465644 (+ 9400us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.465665 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.465877 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.466396 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.466401 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.466440 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:32.466926 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.466944 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.468349 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.468354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.471184 (+ 2830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.471201 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.473170 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.473177 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.473356 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.473391 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.473493 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.473643 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9234,"mutex_wait_us":3,"thread_start_us":10692,"threads_started":1}
I20260805 22:54:32.475169 32503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.456357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:46597 (local address 127.20.34.65:36527)
0805 22:54:32.467228 (+ 10871us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.467244 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.467414 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.467949 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.467952 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.467972 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:32.468389 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.468405 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.470033 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.470039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.472306 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.472331 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.474298 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.474307 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.474523 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.474557 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.474685 (+ 128us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.474832 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10764,"thread_start_us":9943,"threads_started":1}
W20260805 22:54:32.475181 32264 tablet.cc:2369] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:54:32.475478 32185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c2c705a3bc4b0aa6a118c9d8645301" candidate_uuid: "9531c68b152c46718ea31ae8ac90f73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" is_pre_election: true
I20260805 22:54:32.476018 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.456941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:36527 (local address 127.20.34.67:46597)
0805 22:54:32.459368 (+ 2427us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.459373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.467353 (+ 7980us) server_negotiation.cc:407] Connection header received
0805 22:54:32.467598 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.467605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.467688 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.467766 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:32.468622 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.469832 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.472509 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.473870 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.474014 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.474101 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.474746 (+ 645us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.475726 (+ 980us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2326,"thread_start_us":9649,"threads_started":1}
I20260805 22:54:32.476110 32185 raft_consensus.cc:2379] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9531c68b152c46718ea31ae8ac90f73e in current term 1: Already voted for candidate fa1314fe48a04f8fb891d67d4c9b98ff in this term.
I20260805 22:54:32.476589 32084 leader_election.cc:302] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92866fbb1dce4dc3bb0418f76985a488, fa1314fe48a04f8fb891d67d4c9b98ff; no voters:
I20260805 22:54:32.476629 32383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9c2c705a3bc4b0aa6a118c9d8645301" candidate_uuid: "9531c68b152c46718ea31ae8ac90f73e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92866fbb1dce4dc3bb0418f76985a488" is_pre_election: true
I20260805 22:54:32.476919 32383 raft_consensus.cc:2379] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9531c68b152c46718ea31ae8ac90f73e in current term 1: Already voted for candidate fa1314fe48a04f8fb891d67d4c9b98ff in this term.
I20260805 22:54:32.477564 31871 leader_election.cc:302] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9531c68b152c46718ea31ae8ac90f73e; no voters: 92866fbb1dce4dc3bb0418f76985a488, fa1314fe48a04f8fb891d67d4c9b98ff
I20260805 22:54:32.477649 31985 raft_consensus.cc:2454] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 1.
I20260805 22:54:32.478243 32498 raft_consensus.cc:2726] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260805 22:54:32.478403 32497 leader_election.cc:288] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 election: Requested vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597)
I20260805 22:54:32.478653 32497 raft_consensus.cc:2781] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:32.478806 32497 raft_consensus.cc:686] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 LEADER]: Becoming Leader. State: Replica: fa1314fe48a04f8fb891d67d4c9b98ff, State: Running, Role: LEADER
I20260805 22:54:32.479300 32497 consensus_queue.cc:237] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.485064 31739 catalog_manager.cc:5495] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66). New cstate: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } health_report { overall_health: UNKNOWN } } }
I20260805 22:54:32.509344 32482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.503504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37270 (local address 127.20.34.66:37907)
0805 22:54:32.503710 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.503716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.503737 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:54:32.504008 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.504013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.504098 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.504330 (+ 232us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:32.504711 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.505500 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.506850 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.507304 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.507461 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.507958 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:32.508633 (+ 675us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:32.508803 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.508894 (+ 91us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.508992 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260805 22:54:32.517989 32383 raft_consensus.cc:1261] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Refusing update from remote peer fa1314fe48a04f8fb891d67d4c9b98ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:32.518039 31985 raft_consensus.cc:1261] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Refusing update from remote peer fa1314fe48a04f8fb891d67d4c9b98ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:32.518951 32507 consensus_queue.cc:1035] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:32.519435 32497 consensus_queue.cc:1035] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:32.532521 32510 mvcc.cc:205] Tried to move back new op lower bound from 7315335055423008768 to 7315335055279951872. Current Snapshot: MvccSnapshot[applied={T|T < 7315335055423008768}]
I20260805 22:54:32.548967 31739 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:32.549286 31739 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:32.553730 31739 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: Sending DeleteTablet for 3 replicas of tablet d9c2c705a3bc4b0aa6a118c9d8645301
I20260805 22:54:32.555114 32156 tablet_service.cc:1514] Processing DeleteTablet for tablet d9c2c705a3bc4b0aa6a118c9d8645301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:32 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:37268
I20260805 22:54:32.555106 31949 tablet_service.cc:1514] Processing DeleteTablet for tablet d9c2c705a3bc4b0aa6a118c9d8645301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:32 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:42808
I20260805 22:54:32.555181 32355 tablet_service.cc:1514] Processing DeleteTablet for tablet d9c2c705a3bc4b0aa6a118c9d8645301 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:32 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57292
I20260805 22:54:32.559130 31739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57846:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:54:32.561285 31739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:32.566020 32531 tablet_replica.cc:330] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: stopping tablet replica
I20260805 22:54:32.566905 32528 tablet_replica.cc:330] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: stopping tablet replica
I20260805 22:54:32.567430 32528 raft_consensus.cc:2229] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:54:32.568228 32528 raft_consensus.cc:2258] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:32.568920 32531 raft_consensus.cc:2229] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:32.569486 32531 raft_consensus.cc:2258] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:32.571779 32531 ts_tablet_manager.cc:1905] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:32.577231 32355 tablet_service.cc:1467] Processing CreateTablet for tablet 59c290a8f6db4ab2bfa59cf10100e6bb (DEFAULT_TABLE table=test-table [id=dc36c7b9d04046d1b4a7c82f2e54824e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:32.577541 31948 tablet_service.cc:1467] Processing CreateTablet for tablet 59c290a8f6db4ab2bfa59cf10100e6bb (DEFAULT_TABLE table=test-table [id=dc36c7b9d04046d1b4a7c82f2e54824e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:32.577771 32355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c290a8f6db4ab2bfa59cf10100e6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:32.578173 31948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c290a8f6db4ab2bfa59cf10100e6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:32.578347 32156 tablet_service.cc:1467] Processing CreateTablet for tablet 59c290a8f6db4ab2bfa59cf10100e6bb (DEFAULT_TABLE table=test-table [id=dc36c7b9d04046d1b4a7c82f2e54824e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:32.579058 32156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59c290a8f6db4ab2bfa59cf10100e6bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:32.584770 32492 tablet_bootstrap.cc:492] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: Bootstrap starting.
I20260805 22:54:32.585680 32490 tablet_bootstrap.cc:492] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: Bootstrap starting.
I20260805 22:54:32.587589 32490 tablet_bootstrap.cc:654] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.593588 32528 ts_tablet_manager.cc:1905] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:32.596249 32530 tablet_replica.cc:330] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: stopping tablet replica
I20260805 22:54:32.596781 32530 raft_consensus.cc:2229] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:32.597371 32530 raft_consensus.cc:2258] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:32.600487 32488 tablet_bootstrap.cc:492] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: Bootstrap starting.
I20260805 22:54:32.602880 32488 tablet_bootstrap.cc:654] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.606993 32530 ts_tablet_manager.cc:1905] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:32.607784 32528 ts_tablet_manager.cc:1918] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:32.608023 32528 log.cc:1196] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/d9c2c705a3bc4b0aa6a118c9d8645301
I20260805 22:54:32.611166 32492 tablet_bootstrap.cc:654] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.612190 32531 ts_tablet_manager.cc:1918] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:32.612399 32531 log.cc:1196] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/d9c2c705a3bc4b0aa6a118c9d8645301
I20260805 22:54:32.612993 32531 ts_tablet_manager.cc:1939] T d9c2c705a3bc4b0aa6a118c9d8645301 P 92866fbb1dce4dc3bb0418f76985a488: Deleting consensus metadata
I20260805 22:54:32.615120 31721 catalog_manager.cc:4841] TS 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597): tablet d9c2c705a3bc4b0aa6a118c9d8645301 (table test-table [id=690a4dcead8f40cf87484c4fd0c71f4f]) successfully deleted
I20260805 22:54:32.616392 32490 tablet_bootstrap.cc:492] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: No bootstrap required, opened a new log
I20260805 22:54:32.616600 32490 ts_tablet_manager.cc:1397] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.005s
I20260805 22:54:32.617626 32490 raft_consensus.cc:348] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.617885 32490 raft_consensus.cc:374] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.617990 32490 raft_consensus.cc:729] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9531c68b152c46718ea31ae8ac90f73e, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.618395 32490 consensus_queue.cc:260] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.619051 32490 ts_tablet_manager.cc:1428] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 22:54:32.619942 32528 ts_tablet_manager.cc:1939] T d9c2c705a3bc4b0aa6a118c9d8645301 P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting consensus metadata
I20260805 22:54:32.621543 32492 tablet_bootstrap.cc:492] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: No bootstrap required, opened a new log
I20260805 22:54:32.621793 32492 ts_tablet_manager.cc:1397] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.006s
I20260805 22:54:32.622000 31723 catalog_manager.cc:4841] TS fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907): tablet d9c2c705a3bc4b0aa6a118c9d8645301 (table test-table [id=690a4dcead8f40cf87484c4fd0c71f4f]) successfully deleted
I20260805 22:54:32.622880 32492 raft_consensus.cc:348] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.623140 32492 raft_consensus.cc:374] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.623246 32492 raft_consensus.cc:729] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92866fbb1dce4dc3bb0418f76985a488, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.623550 32492 consensus_queue.cc:260] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.624204 32492 ts_tablet_manager.cc:1428] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260805 22:54:32.625540 32488 tablet_bootstrap.cc:492] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: No bootstrap required, opened a new log
I20260805 22:54:32.625710 32488 ts_tablet_manager.cc:1397] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.015s
I20260805 22:54:32.626626 32488 raft_consensus.cc:348] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.626881 32488 raft_consensus.cc:374] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.626983 32488 raft_consensus.cc:729] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1314fe48a04f8fb891d67d4c9b98ff, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.627349 32488 consensus_queue.cc:260] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.627997 32488 ts_tablet_manager.cc:1428] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260805 22:54:32.629617 32530 ts_tablet_manager.cc:1918] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:32.629839 32530 log.cc:1196] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/d9c2c705a3bc4b0aa6a118c9d8645301
I20260805 22:54:32.630439 32530 ts_tablet_manager.cc:1939] T d9c2c705a3bc4b0aa6a118c9d8645301 P 9531c68b152c46718ea31ae8ac90f73e: Deleting consensus metadata
I20260805 22:54:32.632090 31722 catalog_manager.cc:4841] TS 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863): tablet d9c2c705a3bc4b0aa6a118c9d8645301 (table test-table [id=690a4dcead8f40cf87484c4fd0c71f4f]) successfully deleted
W20260805 22:54:32.641415 32057 tablet.cc:2369] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:54:32.721956 32518 raft_consensus.cc:482] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:32.722220 32518 raft_consensus.cc:504] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.723157 32518 leader_election.cc:288] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597)
I20260805 22:54:32.723841 32383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c290a8f6db4ab2bfa59cf10100e6bb" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92866fbb1dce4dc3bb0418f76985a488" is_pre_election: true
I20260805 22:54:32.723827 31985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c290a8f6db4ab2bfa59cf10100e6bb" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e" is_pre_election: true
I20260805 22:54:32.724107 31985 raft_consensus.cc:2454] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 0.
I20260805 22:54:32.724108 32383 raft_consensus.cc:2454] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 0.
I20260805 22:54:32.724656 32087 leader_election.cc:302] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9531c68b152c46718ea31ae8ac90f73e, fa1314fe48a04f8fb891d67d4c9b98ff; no voters:
I20260805 22:54:32.725023 32518 raft_consensus.cc:2781] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:32.725184 32518 raft_consensus.cc:482] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:32.725324 32518 raft_consensus.cc:3037] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.728478 32518 raft_consensus.cc:504] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.729249 32518 leader_election.cc:288] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 election: Requested vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597)
I20260805 22:54:32.729861 31985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c290a8f6db4ab2bfa59cf10100e6bb" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e"
I20260805 22:54:32.729868 32383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59c290a8f6db4ab2bfa59cf10100e6bb" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92866fbb1dce4dc3bb0418f76985a488"
I20260805 22:54:32.730090 31985 raft_consensus.cc:3037] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.730106 32383 raft_consensus.cc:3037] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.732327 31985 raft_consensus.cc:2454] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 1.
I20260805 22:54:32.732870 32087 leader_election.cc:302] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9531c68b152c46718ea31ae8ac90f73e, fa1314fe48a04f8fb891d67d4c9b98ff; no voters:
I20260805 22:54:32.733197 32518 raft_consensus.cc:2781] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:32.733335 32383 raft_consensus.cc:2454] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 1.
I20260805 22:54:32.733379 32518 raft_consensus.cc:686] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 LEADER]: Becoming Leader. State: Replica: fa1314fe48a04f8fb891d67d4c9b98ff, State: Running, Role: LEADER
I20260805 22:54:32.733698 32518 consensus_queue.cc:237] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.737787 31739 catalog_manager.cc:5495] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66). New cstate: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } health_report { overall_health: UNKNOWN } } }
Aug 05 22:54:32 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970469, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.126@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:32.799932 32546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.783024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45775 (local address 127.0.0.1:57858)
0805 22:54:32.783822 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.783851 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.784028 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.784493 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.784498 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.785447 (+ 949us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:32.785819 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.785831 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.786867 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.786872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.788452 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.788469 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.789385 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.789413 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.789563 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.790450 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:32.790488 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:32.793059 (+ 2571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:32.797180 (+ 4121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:32.797193 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:32.797200 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:32.797658 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:32.798139 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:32.798143 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:32.798146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:32.798308 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:32.799016 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:32.799022 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:32.799208 (+ 186us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.799360 (+ 152us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.799590 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":446,"threads_started":1}
I20260805 22:54:32.800429 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.783026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57858 (local address 127.20.34.126:45775)
0805 22:54:32.783325 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.783335 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.784025 (+ 690us) server_negotiation.cc:407] Connection header received
0805 22:54:32.784227 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.784233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.784314 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.784406 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:32.785980 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.786721 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.788597 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.789124 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.789310 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.793304 (+ 3994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:32.793312 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:32.793317 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:32.793361 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:32.796977 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:32.797797 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:32.797803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:32.797807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:32.797968 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:32.798459 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:32.798464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:32.798468 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:32.798852 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:32.799015 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.799524 (+ 509us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.799770 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260805 22:54:32.806361 31739 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57858:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 22:54:32.807578 31739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:32.815670 31949 tablet_service.cc:1467] Processing CreateTablet for tablet 6d66f22cdd50463c97eaa966028ef972 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=55859f7c4e1c4a06b5e830935a9bb7e4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:54:32.815917 32156 tablet_service.cc:1467] Processing CreateTablet for tablet 6d66f22cdd50463c97eaa966028ef972 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=55859f7c4e1c4a06b5e830935a9bb7e4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:54:32.815992 32355 tablet_service.cc:1467] Processing CreateTablet for tablet 6d66f22cdd50463c97eaa966028ef972 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=55859f7c4e1c4a06b5e830935a9bb7e4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 22:54:32.816434 31949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d66f22cdd50463c97eaa966028ef972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:32.816476 32156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d66f22cdd50463c97eaa966028ef972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:32.816656 32355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d66f22cdd50463c97eaa966028ef972. 1 dirs total, 0 dirs full, 0 dirs failed
W20260805 22:54:32.820398 32455 tablet.cc:2369] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:54:32.825058 32488 tablet_bootstrap.cc:492] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: Bootstrap starting.
I20260805 22:54:32.825248 32490 tablet_bootstrap.cc:492] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: Bootstrap starting.
I20260805 22:54:32.827158 32488 tablet_bootstrap.cc:654] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.827157 32490 tablet_bootstrap.cc:654] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.828481 32492 tablet_bootstrap.cc:492] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: Bootstrap starting.
I20260805 22:54:32.830928 32492 tablet_bootstrap.cc:654] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:32.834456 32492 tablet_bootstrap.cc:492] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: No bootstrap required, opened a new log
I20260805 22:54:32.834667 32492 ts_tablet_manager.cc:1397] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260805 22:54:32.835397 32490 tablet_bootstrap.cc:492] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: No bootstrap required, opened a new log
I20260805 22:54:32.835645 32490 ts_tablet_manager.cc:1397] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.006s
I20260805 22:54:32.835510 32492 raft_consensus.cc:348] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.835791 32492 raft_consensus.cc:374] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.835882 32492 raft_consensus.cc:729] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92866fbb1dce4dc3bb0418f76985a488, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.836690 32490 raft_consensus.cc:348] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.836964 32488 tablet_bootstrap.cc:492] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: No bootstrap required, opened a new log
I20260805 22:54:32.836952 32490 raft_consensus.cc:374] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.837038 32490 raft_consensus.cc:729] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9531c68b152c46718ea31ae8ac90f73e, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.837155 32488 ts_tablet_manager.cc:1397] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20260805 22:54:32.837291 32492 consensus_queue.cc:260] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.837344 32490 consensus_queue.cc:260] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.837809 32498 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.838104 32498 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:54:32.837992 32488 raft_consensus.cc:348] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.837899 32496 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.838248 32496 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:54:32.838243 32488 raft_consensus.cc:374] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:32.838326 32488 raft_consensus.cc:729] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1314fe48a04f8fb891d67d4c9b98ff, State: Initialized, Role: FOLLOWER
I20260805 22:54:32.838621 32488 consensus_queue.cc:260] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.839016 32492 ts_tablet_manager.cc:1428] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260805 22:54:32.839273 32488 ts_tablet_manager.cc:1428] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260805 22:54:32.839725 32518 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.840022 32518 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:54:32.841260 32490 ts_tablet_manager.cc:1428] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260805 22:54:32.919265 32518 raft_consensus.cc:482] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:32.919543 32518 raft_consensus.cc:504] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.920431 32518 leader_election.cc:288] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597)
I20260805 22:54:32.921060 32383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d66f22cdd50463c97eaa966028ef972" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92866fbb1dce4dc3bb0418f76985a488" is_pre_election: true
I20260805 22:54:32.921110 31985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d66f22cdd50463c97eaa966028ef972" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e" is_pre_election: true
I20260805 22:54:32.921365 32383 raft_consensus.cc:2454] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 0.
I20260805 22:54:32.921419 31985 raft_consensus.cc:2454] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 0.
I20260805 22:54:32.921895 32084 leader_election.cc:302] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92866fbb1dce4dc3bb0418f76985a488, fa1314fe48a04f8fb891d67d4c9b98ff; no voters:
I20260805 22:54:32.922299 32518 raft_consensus.cc:2781] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:32.922469 32518 raft_consensus.cc:482] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:32.922597 32518 raft_consensus.cc:3037] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.925078 32518 raft_consensus.cc:504] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.925858 32518 leader_election.cc:288] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 election: Requested vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597)
I20260805 22:54:32.926412 31985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d66f22cdd50463c97eaa966028ef972" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e"
I20260805 22:54:32.926496 32383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d66f22cdd50463c97eaa966028ef972" candidate_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92866fbb1dce4dc3bb0418f76985a488"
I20260805 22:54:32.926690 31985 raft_consensus.cc:3037] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.926753 32383 raft_consensus.cc:3037] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:32.929850 31985 raft_consensus.cc:2454] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 1.
I20260805 22:54:32.929844 32383 raft_consensus.cc:2454] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1314fe48a04f8fb891d67d4c9b98ff in term 1.
I20260805 22:54:32.930400 32084 leader_election.cc:302] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92866fbb1dce4dc3bb0418f76985a488, fa1314fe48a04f8fb891d67d4c9b98ff; no voters:
I20260805 22:54:32.930835 32518 raft_consensus.cc:2781] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:32.931054 32518 raft_consensus.cc:686] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 LEADER]: Becoming Leader. State: Replica: fa1314fe48a04f8fb891d67d4c9b98ff, State: Running, Role: LEADER
I20260805 22:54:32.931330 32518 consensus_queue.cc:237] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:32.933609 32497 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: TxnStatusTablet state changed. Reason: New leader fa1314fe48a04f8fb891d67d4c9b98ff. Latest consensus state: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.933946 32497 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:54:32.934751 32554 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 22:54:32.935014 32554 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 22:54:32.935436 31740 catalog_manager.cc:5495] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff reported cstate change: term changed from 0 to 1, leader changed from <none> to fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66). New cstate: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } health_report { overall_health: UNKNOWN } } }
I20260805 22:54:32.970463 32482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.965117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37284 (local address 127.20.34.66:37907)
0805 22:54:32.965296 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:32.965302 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:32.965368 (+ 66us) server_negotiation.cc:407] Connection header received
0805 22:54:32.965677 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:32.965690 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:32.965762 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:32.965914 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:32.966320 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.967095 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.968529 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.969033 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.969196 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.969633 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:32.969745 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:32.969879 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:32.970047 (+ 168us) server_negotiation.cc:299] Negotiation successful
0805 22:54:32.970130 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 22:54:32.970474 32546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:32.964983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37907 (local address 127.0.0.1:37284)
0805 22:54:32.965272 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:32.965294 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:32.965478 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:32.965949 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:32.965953 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:32.965967 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:54:32.966166 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.966174 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.967232 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.967239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.968382 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:32.968395 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:32.969213 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:32.969219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:32.969373 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:32.969432 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:54:32.969894 (+ 462us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:54:32.969925 (+ 31us) client_negotiation.cc:769] Sending connection context
0805 22:54:32.970019 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 22:54:32.970176 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260805 22:54:32.974875 32383 raft_consensus.cc:1261] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Refusing update from remote peer fa1314fe48a04f8fb891d67d4c9b98ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:32.974992 31985 raft_consensus.cc:1261] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Refusing update from remote peer fa1314fe48a04f8fb891d67d4c9b98ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:32.975634 32497 consensus_queue.cc:1035] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:32.976081 32518 consensus_queue.cc:1035] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:32.979106 32496 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: TxnStatusTablet state changed. Reason: New leader fa1314fe48a04f8fb891d67d4c9b98ff. Latest consensus state: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.979390 32496 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:54:32.980837 32518 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.981204 32518 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:54:32.984241 32514 mvcc.cc:205] Tried to move back new op lower bound from 7315335057298755584 to 7315335057129865216. Current Snapshot: MvccSnapshot[applied={T|T < 7315335057298755584}]
I20260805 22:54:32.985210 32496 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.985495 32496 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P 92866fbb1dce4dc3bb0418f76985a488: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:54:32.994336 32507 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.994729 32507 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P fa1314fe48a04f8fb891d67d4c9b98ff: This TxnStatusTablet replica's current role is: LEADER
I20260805 22:54:32.995029 32498 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: TxnStatusTablet state changed. Reason: New leader fa1314fe48a04f8fb891d67d4c9b98ff. Latest consensus state: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.995342 32498 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:54:32.999500 32498 tablet_replica.cc:439] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } } }
I20260805 22:54:32.999855 32498 tablet_replica.cc:442] T 6d66f22cdd50463c97eaa966028ef972 P 9531c68b152c46718ea31ae8ac90f73e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 22:54:33.012753 32482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.006676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:37703 (local address 127.20.34.66:37907)
0805 22:54:33.006880 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.006887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.007372 (+ 485us) server_negotiation.cc:407] Connection header received
0805 22:54:33.007549 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.007556 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.007652 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.007759 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:33.008288 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.009175 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.010716 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.011204 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.011369 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.011824 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:33.011962 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:33.012068 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.012273 (+ 205us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.012355 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 22:54:33.012809 32562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.006571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37907 (local address 127.20.34.66:37703)
0805 22:54:33.007262 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:33.007279 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:33.007413 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:33.007783 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:33.007786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:33.007799 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:54:33.008088 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.008096 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.009322 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.009330 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.010560 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.010571 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.011413 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.011426 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.011559 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.011622 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:54:33.012068 (+ 446us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:54:33.012081 (+ 13us) client_negotiation.cc:769] Sending connection context
0805 22:54:33.012233 (+ 152us) client_negotiation.cc:240] Negotiation successful
0805 22:54:33.012386 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":357,"threads_started":1}
I20260805 22:54:33.023761 31985 raft_consensus.cc:1261] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Refusing update from remote peer fa1314fe48a04f8fb891d67d4c9b98ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:33.023917 32383 raft_consensus.cc:1261] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Refusing update from remote peer fa1314fe48a04f8fb891d67d4c9b98ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:33.024453 32518 consensus_queue.cc:1035] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:33.024744 32507 consensus_queue.cc:1035] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:33.109259 31739 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:33.109571 31739 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:33.113148 31739 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: Sending DeleteTablet for 3 replicas of tablet 59c290a8f6db4ab2bfa59cf10100e6bb
I20260805 22:54:33.114039 31949 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c290a8f6db4ab2bfa59cf10100e6bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:42808
I20260805 22:54:33.114141 32155 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c290a8f6db4ab2bfa59cf10100e6bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:37268
I20260805 22:54:33.114516 32528 tablet_replica.cc:330] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: stopping tablet replica
I20260805 22:54:33.114670 32530 tablet_replica.cc:330] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: stopping tablet replica
I20260805 22:54:33.114737 32528 raft_consensus.cc:2229] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:54:33.114892 32530 raft_consensus.cc:2229] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:33.115109 32530 raft_consensus.cc:2258] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.115125 32528 raft_consensus.cc:2258] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.115468 32355 tablet_service.cc:1514] Processing DeleteTablet for tablet 59c290a8f6db4ab2bfa59cf10100e6bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57292
I20260805 22:54:33.116137 32531 tablet_replica.cc:330] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: stopping tablet replica
I20260805 22:54:33.116372 32531 raft_consensus.cc:2229] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:33.116585 32531 raft_consensus.cc:2258] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.118230 32528 ts_tablet_manager.cc:1905] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:33.121296 32531 ts_tablet_manager.cc:1905] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:33.123478 32530 ts_tablet_manager.cc:1905] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:33.131863 32530 ts_tablet_manager.cc:1918] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:54:33.132059 32530 log.cc:1196] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/59c290a8f6db4ab2bfa59cf10100e6bb
I20260805 22:54:33.132520 32530 ts_tablet_manager.cc:1939] T 59c290a8f6db4ab2bfa59cf10100e6bb P 9531c68b152c46718ea31ae8ac90f73e: Deleting consensus metadata
I20260805 22:54:33.133744 31722 catalog_manager.cc:4841] TS 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863): tablet 59c290a8f6db4ab2bfa59cf10100e6bb (table test-table [id=dc36c7b9d04046d1b4a7c82f2e54824e]) successfully deleted
I20260805 22:54:33.134016 32531 ts_tablet_manager.cc:1918] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:54:33.134195 32531 log.cc:1196] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/59c290a8f6db4ab2bfa59cf10100e6bb
I20260805 22:54:33.134678 32531 ts_tablet_manager.cc:1939] T 59c290a8f6db4ab2bfa59cf10100e6bb P 92866fbb1dce4dc3bb0418f76985a488: Deleting consensus metadata
I20260805 22:54:33.135878 31721 catalog_manager.cc:4841] TS 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597): tablet 59c290a8f6db4ab2bfa59cf10100e6bb (table test-table [id=dc36c7b9d04046d1b4a7c82f2e54824e]) successfully deleted
I20260805 22:54:33.137116 32528 ts_tablet_manager.cc:1918] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:54:33.137301 32528 log.cc:1196] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/59c290a8f6db4ab2bfa59cf10100e6bb
I20260805 22:54:33.137791 32528 ts_tablet_manager.cc:1939] T 59c290a8f6db4ab2bfa59cf10100e6bb P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting consensus metadata
I20260805 22:54:33.139055 31723 catalog_manager.cc:4841] TS fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907): tablet 59c290a8f6db4ab2bfa59cf10100e6bb (table test-table [id=dc36c7b9d04046d1b4a7c82f2e54824e]) successfully deleted
Aug 05 22:54:33 dist-test-slave-gmjp krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 22:54:33 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:33 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:54:33.210804 32300 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:33.197521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57874 (local address 127.20.34.126:45775)
0805 22:54:33.197729 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.197737 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.198363 (+ 626us) server_negotiation.cc:407] Connection header received
0805 22:54:33.198660 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.198673 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.198745 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.198861 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:33.200587 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.201824 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.203205 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.203917 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.204058 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.210515 (+ 6457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57874: BlockingRecv error: recv got EOF from 127.0.0.1:57874 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 05 22:54:33 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM
I20260805 22:54:33.230780 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.213749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57876 (local address 127.20.34.126:45775)
0805 22:54:33.213944 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.213953 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.214256 (+ 303us) server_negotiation.cc:407] Connection header received
0805 22:54:33.214406 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.214412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.214502 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.214616 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:33.215937 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.217196 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.218632 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.219334 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.219478 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.223901 (+ 4423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:33.223911 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:33.223917 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:33.223975 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:33.227711 (+ 3736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:33.228570 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:33.228577 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:33.228581 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:33.228745 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:33.229150 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:33.229156 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:33.229160 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:33.229577 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:33.229842 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.230122 (+ 280us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.230378 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 22:54:33.234859 31739 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:54:33.235656 31739 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:33.244118 31949 tablet_service.cc:1467] Processing CreateTablet for tablet d5e10b4a9fab4e4e9a9822662beca73b (DEFAULT_TABLE table=test-table [id=84ac25df8fb84766913c2513093293cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:33.244433 32355 tablet_service.cc:1467] Processing CreateTablet for tablet d5e10b4a9fab4e4e9a9822662beca73b (DEFAULT_TABLE table=test-table [id=84ac25df8fb84766913c2513093293cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:33.244727 31949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e10b4a9fab4e4e9a9822662beca73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:33.244874 32355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e10b4a9fab4e4e9a9822662beca73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:33.249558 32155 tablet_service.cc:1467] Processing CreateTablet for tablet d5e10b4a9fab4e4e9a9822662beca73b (DEFAULT_TABLE table=test-table [id=84ac25df8fb84766913c2513093293cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:33.250185 32155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e10b4a9fab4e4e9a9822662beca73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:33.250411 32492 tablet_bootstrap.cc:492] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: Bootstrap starting.
I20260805 22:54:33.252252 32492 tablet_bootstrap.cc:654] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:33.254441 32492 tablet_bootstrap.cc:492] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: No bootstrap required, opened a new log
I20260805 22:54:33.254578 32492 ts_tablet_manager.cc:1397] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260805 22:54:33.255431 32492 raft_consensus.cc:348] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.255697 32492 raft_consensus.cc:374] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:33.255782 32492 raft_consensus.cc:729] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92866fbb1dce4dc3bb0418f76985a488, State: Initialized, Role: FOLLOWER
I20260805 22:54:33.256054 32492 consensus_queue.cc:260] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.256709 32488 tablet_bootstrap.cc:492] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: Bootstrap starting.
I20260805 22:54:33.256898 32492 ts_tablet_manager.cc:1428] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260805 22:54:33.258047 32490 tablet_bootstrap.cc:492] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: Bootstrap starting.
I20260805 22:54:33.258659 32488 tablet_bootstrap.cc:654] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:33.259781 32490 tablet_bootstrap.cc:654] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:33.262815 32488 tablet_bootstrap.cc:492] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: No bootstrap required, opened a new log
I20260805 22:54:33.263005 32488 ts_tablet_manager.cc:1397] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260805 22:54:33.263790 32490 tablet_bootstrap.cc:492] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: No bootstrap required, opened a new log
I20260805 22:54:33.263996 32490 ts_tablet_manager.cc:1397] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260805 22:54:33.263814 32488 raft_consensus.cc:348] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.264185 32488 raft_consensus.cc:374] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:33.264338 32488 raft_consensus.cc:729] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1314fe48a04f8fb891d67d4c9b98ff, State: Initialized, Role: FOLLOWER
I20260805 22:54:33.264622 32488 consensus_queue.cc:260] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.264837 32490 raft_consensus.cc:348] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.265095 32490 raft_consensus.cc:374] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:33.265183 32490 raft_consensus.cc:729] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9531c68b152c46718ea31ae8ac90f73e, State: Initialized, Role: FOLLOWER
I20260805 22:54:33.265276 32488 ts_tablet_manager.cc:1428] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260805 22:54:33.265460 32490 consensus_queue.cc:260] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.266963 32490 ts_tablet_manager.cc:1428] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260805 22:54:33.284559 32496 raft_consensus.cc:482] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:33.284862 32496 raft_consensus.cc:504] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.286710 32496 leader_election.cc:288] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907)
I20260805 22:54:33.298400 32591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.286914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:36863 (local address 127.20.34.67:55931)
0805 22:54:33.288361 (+ 1447us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:33.288395 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:33.288964 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:33.290157 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:33.290164 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:33.290227 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:33.290702 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.290716 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.292845 (+ 2129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.292851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.295285 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.295311 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.297364 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.297371 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.297605 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.297646 (+ 41us) client_negotiation.cc:769] Sending connection context
0805 22:54:33.297762 (+ 116us) client_negotiation.cc:240] Negotiation successful
0805 22:54:33.297933 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1280,"mutex_wait_us":48,"thread_start_us":3407,"threads_started":1}
I20260805 22:54:33.298496 32592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.287510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:55931 (local address 127.20.34.65:36863)
0805 22:54:33.289708 (+ 2198us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.289715 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.289750 (+ 35us) server_negotiation.cc:407] Connection header received
0805 22:54:33.289839 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.289848 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.289952 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.290938 (+ 986us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:33.291150 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.292658 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.295521 (+ 2863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.297089 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.297340 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.297455 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.297832 (+ 377us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.298013 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2044,"thread_start_us":1803,"threads_started":1}
I20260805 22:54:33.299284 31980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e10b4a9fab4e4e9a9822662beca73b" candidate_uuid: "92866fbb1dce4dc3bb0418f76985a488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e" is_pre_election: true
I20260805 22:54:33.299477 32588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.287025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37907 (local address 127.20.34.67:58449)
0805 22:54:33.289863 (+ 2838us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:33.289888 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:33.290095 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:33.290883 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:33.290888 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:33.290917 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:54:33.291331 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.291342 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.293107 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.293114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.295215 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.295238 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.297676 (+ 2438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.297683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.297929 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.297974 (+ 45us) client_negotiation.cc:769] Sending connection context
0805 22:54:33.298787 (+ 813us) client_negotiation.cc:240] Negotiation successful
0805 22:54:33.298955 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2698,"mutex_wait_us":28,"thread_start_us":949,"threads_started":1}
I20260805 22:54:33.299678 31980 raft_consensus.cc:2454] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92866fbb1dce4dc3bb0418f76985a488 in term 0.
I20260805 22:54:33.300236 32482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.287528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:58449 (local address 127.20.34.66:37907)
0805 22:54:33.287850 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.287860 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.289982 (+ 2122us) server_negotiation.cc:407] Connection header received
0805 22:54:33.290344 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.290350 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.290463 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.290556 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:54:33.291520 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.292936 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.295432 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.297241 (+ 1809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.297453 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.297572 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.298206 (+ 634us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.298383 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260805 22:54:33.300381 32289 leader_election.cc:302] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92866fbb1dce4dc3bb0418f76985a488, 9531c68b152c46718ea31ae8ac90f73e; no voters:
I20260805 22:54:33.300925 32496 raft_consensus.cc:2781] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:33.301088 32496 raft_consensus.cc:482] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:33.301223 32496 raft_consensus.cc:3037] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:33.301601 32185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e10b4a9fab4e4e9a9822662beca73b" candidate_uuid: "92866fbb1dce4dc3bb0418f76985a488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" is_pre_election: true
I20260805 22:54:33.301976 32185 raft_consensus.cc:2454] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92866fbb1dce4dc3bb0418f76985a488 in term 0.
I20260805 22:54:33.304534 32496 raft_consensus.cc:504] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.305421 32496 leader_election.cc:288] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [CANDIDATE]: Term 1 election: Requested vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907)
I20260805 22:54:33.306061 31980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e10b4a9fab4e4e9a9822662beca73b" candidate_uuid: "92866fbb1dce4dc3bb0418f76985a488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e"
I20260805 22:54:33.306185 32185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e10b4a9fab4e4e9a9822662beca73b" candidate_uuid: "92866fbb1dce4dc3bb0418f76985a488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff"
I20260805 22:54:33.306352 31980 raft_consensus.cc:3037] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:33.306464 32185 raft_consensus.cc:3037] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:33.309317 31980 raft_consensus.cc:2454] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92866fbb1dce4dc3bb0418f76985a488 in term 1.
I20260805 22:54:33.310014 32289 leader_election.cc:302] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92866fbb1dce4dc3bb0418f76985a488, 9531c68b152c46718ea31ae8ac90f73e; no voters:
I20260805 22:54:33.310143 32185 raft_consensus.cc:2454] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92866fbb1dce4dc3bb0418f76985a488 in term 1.
I20260805 22:54:33.310573 32496 raft_consensus.cc:2781] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:33.311381 32496 raft_consensus.cc:686] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 LEADER]: Becoming Leader. State: Replica: 92866fbb1dce4dc3bb0418f76985a488, State: Running, Role: LEADER
I20260805 22:54:33.311897 32496 consensus_queue.cc:237] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.316604 31739 catalog_manager.cc:5495] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "92866fbb1dce4dc3bb0418f76985a488" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } health_report { overall_health: HEALTHY } } }
I20260805 22:54:33.344482 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.337297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57298 (local address 127.20.34.67:46597)
0805 22:54:33.337832 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.337837 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.337854 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:54:33.337949 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.337953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.338033 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.338190 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:33.338694 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.339606 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.341660 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.342161 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.342275 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.342887 (+ 612us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:33.343619 (+ 732us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:33.343780 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.343898 (+ 118us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.343987 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":309,"threads_started":1}
I20260805 22:54:33.348776 31980 raft_consensus.cc:1261] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Refusing update from remote peer 92866fbb1dce4dc3bb0418f76985a488: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:33.349309 32185 raft_consensus.cc:1261] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Refusing update from remote peer 92866fbb1dce4dc3bb0418f76985a488: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:33.349644 32593 consensus_queue.cc:1035] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:33.350611 32593 consensus_queue.cc:1035] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:33.362517 32511 mvcc.cc:205] Tried to move back new op lower bound from 7315335058828091392 to 7315335058690834432. Current Snapshot: MvccSnapshot[applied={T|T < 7315335058828091392}]
I20260805 22:54:33.374157 31740 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:33.374459 31740 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:33.378597 31740 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: Sending DeleteTablet for 3 replicas of tablet d5e10b4a9fab4e4e9a9822662beca73b
I20260805 22:54:33.379830 31949 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e10b4a9fab4e4e9a9822662beca73b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:42808
I20260805 22:54:33.379841 32155 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e10b4a9fab4e4e9a9822662beca73b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:37268
I20260805 22:54:33.380229 32530 tablet_replica.cc:330] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: stopping tablet replica
I20260805 22:54:33.380439 32530 raft_consensus.cc:2229] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:33.380699 32530 raft_consensus.cc:2258] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.381044 32528 tablet_replica.cc:330] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: stopping tablet replica
I20260805 22:54:33.381258 32528 raft_consensus.cc:2229] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:33.381554 32528 raft_consensus.cc:2258] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.382566 32355 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e10b4a9fab4e4e9a9822662beca73b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57292
I20260805 22:54:33.383255 32531 tablet_replica.cc:330] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: stopping tablet replica
I20260805 22:54:33.383468 32531 raft_consensus.cc:2229] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:54:33.384044 32531 raft_consensus.cc:2258] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.383852 31740 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:54:33.384617 31740 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:54:33.386418 32530 ts_tablet_manager.cc:1905] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:33.389003 32528 ts_tablet_manager.cc:1905] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:33.392702 32531 ts_tablet_manager.cc:1905] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:33.400190 32531 ts_tablet_manager.cc:1918] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:33.400383 32531 log.cc:1196] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/d5e10b4a9fab4e4e9a9822662beca73b
I20260805 22:54:33.400883 32531 ts_tablet_manager.cc:1939] T d5e10b4a9fab4e4e9a9822662beca73b P 92866fbb1dce4dc3bb0418f76985a488: Deleting consensus metadata
I20260805 22:54:33.402282 31721 catalog_manager.cc:4841] TS 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597): tablet d5e10b4a9fab4e4e9a9822662beca73b (table test-table [id=84ac25df8fb84766913c2513093293cc]) successfully deleted
I20260805 22:54:33.403465 32528 ts_tablet_manager.cc:1918] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:33.403723 32528 log.cc:1196] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/d5e10b4a9fab4e4e9a9822662beca73b
I20260805 22:54:33.403678 31949 tablet_service.cc:1467] Processing CreateTablet for tablet 9810750644924d74b4224726ed00888b (DEFAULT_TABLE table=test-table [id=f03824049ce648518341451657933821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:33.404042 32155 tablet_service.cc:1467] Processing CreateTablet for tablet 9810750644924d74b4224726ed00888b (DEFAULT_TABLE table=test-table [id=f03824049ce648518341451657933821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:33.404495 32528 ts_tablet_manager.cc:1939] T d5e10b4a9fab4e4e9a9822662beca73b P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting consensus metadata
I20260805 22:54:33.404542 32155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9810750644924d74b4224726ed00888b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:33.405108 32355 tablet_service.cc:1467] Processing CreateTablet for tablet 9810750644924d74b4224726ed00888b (DEFAULT_TABLE table=test-table [id=f03824049ce648518341451657933821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:54:33.405602 32355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9810750644924d74b4224726ed00888b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:33.410979 31723 catalog_manager.cc:4841] TS fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907): tablet d5e10b4a9fab4e4e9a9822662beca73b (table test-table [id=84ac25df8fb84766913c2513093293cc]) successfully deleted
I20260805 22:54:33.412300 31949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9810750644924d74b4224726ed00888b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:33.413623 32488 tablet_bootstrap.cc:492] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: Bootstrap starting.
I20260805 22:54:33.415606 32488 tablet_bootstrap.cc:654] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:33.419608 32490 tablet_bootstrap.cc:492] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: Bootstrap starting.
I20260805 22:54:33.421200 32490 tablet_bootstrap.cc:654] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:33.423491 32492 tablet_bootstrap.cc:492] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: Bootstrap starting.
I20260805 22:54:33.425129 32490 tablet_bootstrap.cc:492] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: No bootstrap required, opened a new log
I20260805 22:54:33.425488 32492 tablet_bootstrap.cc:654] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:33.426262 32490 ts_tablet_manager.cc:1397] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20260805 22:54:33.427431 32490 raft_consensus.cc:348] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.427897 32490 raft_consensus.cc:374] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:33.428052 32490 raft_consensus.cc:729] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9531c68b152c46718ea31ae8ac90f73e, State: Initialized, Role: FOLLOWER
I20260805 22:54:33.428517 32490 consensus_queue.cc:260] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.433055 32490 ts_tablet_manager.cc:1428] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260805 22:54:33.434106 32530 ts_tablet_manager.cc:1918] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:54:33.434269 32530 log.cc:1196] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/d5e10b4a9fab4e4e9a9822662beca73b
I20260805 22:54:33.434751 32530 ts_tablet_manager.cc:1939] T d5e10b4a9fab4e4e9a9822662beca73b P 9531c68b152c46718ea31ae8ac90f73e: Deleting consensus metadata
I20260805 22:54:33.436004 31722 catalog_manager.cc:4841] TS 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863): tablet d5e10b4a9fab4e4e9a9822662beca73b (table test-table [id=84ac25df8fb84766913c2513093293cc]) successfully deleted
I20260805 22:54:33.440688 32488 tablet_bootstrap.cc:492] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: No bootstrap required, opened a new log
I20260805 22:54:33.440923 32488 ts_tablet_manager.cc:1397] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.011s
I20260805 22:54:33.440980 32492 tablet_bootstrap.cc:492] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: No bootstrap required, opened a new log
I20260805 22:54:33.441321 32492 ts_tablet_manager.cc:1397] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.005s
I20260805 22:54:33.441955 32488 raft_consensus.cc:348] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.442266 32488 raft_consensus.cc:374] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:33.442380 32488 raft_consensus.cc:729] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1314fe48a04f8fb891d67d4c9b98ff, State: Initialized, Role: FOLLOWER
I20260805 22:54:33.442719 32488 consensus_queue.cc:260] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.443373 32488 ts_tablet_manager.cc:1428] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 22:54:33.443699 32492 raft_consensus.cc:348] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.444103 32492 raft_consensus.cc:374] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:33.444249 32492 raft_consensus.cc:729] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92866fbb1dce4dc3bb0418f76985a488, State: Initialized, Role: FOLLOWER
I20260805 22:54:33.444633 32492 consensus_queue.cc:260] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.447711 32492 ts_tablet_manager.cc:1428] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260805 22:54:33.464604 32593 raft_consensus.cc:482] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:54:33.464859 32593 raft_consensus.cc:504] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.465798 32593 leader_election.cc:288] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907)
I20260805 22:54:33.466454 31980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9810750644924d74b4224726ed00888b" candidate_uuid: "92866fbb1dce4dc3bb0418f76985a488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e" is_pre_election: true
I20260805 22:54:33.466634 32185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9810750644924d74b4224726ed00888b" candidate_uuid: "92866fbb1dce4dc3bb0418f76985a488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" is_pre_election: true
I20260805 22:54:33.466753 31980 raft_consensus.cc:2454] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92866fbb1dce4dc3bb0418f76985a488 in term 0.
I20260805 22:54:33.466941 32185 raft_consensus.cc:2454] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92866fbb1dce4dc3bb0418f76985a488 in term 0.
I20260805 22:54:33.467406 32289 leader_election.cc:302] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92866fbb1dce4dc3bb0418f76985a488, 9531c68b152c46718ea31ae8ac90f73e; no voters:
I20260805 22:54:33.467749 32593 raft_consensus.cc:2781] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:54:33.467896 32593 raft_consensus.cc:482] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:54:33.468037 32593 raft_consensus.cc:3037] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:33.471642 32593 raft_consensus.cc:504] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.472937 31980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9810750644924d74b4224726ed00888b" candidate_uuid: "92866fbb1dce4dc3bb0418f76985a488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9531c68b152c46718ea31ae8ac90f73e"
I20260805 22:54:33.473191 31980 raft_consensus.cc:3037] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:33.478631 31980 raft_consensus.cc:2454] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92866fbb1dce4dc3bb0418f76985a488 in term 1.
I20260805 22:54:33.479198 32289 leader_election.cc:302] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92866fbb1dce4dc3bb0418f76985a488, 9531c68b152c46718ea31ae8ac90f73e; no voters:
I20260805 22:54:33.479590 32496 raft_consensus.cc:2781] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:33.483592 32185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9810750644924d74b4224726ed00888b" candidate_uuid: "92866fbb1dce4dc3bb0418f76985a488" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff"
I20260805 22:54:33.483896 32185 raft_consensus.cc:3037] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:33.487568 32185 raft_consensus.cc:2454] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92866fbb1dce4dc3bb0418f76985a488 in term 1.
I20260805 22:54:33.490962 32593 leader_election.cc:288] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [CANDIDATE]: Term 1 election: Requested vote from peers 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863), fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907)
I20260805 22:54:33.502723 32496 raft_consensus.cc:686] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 LEADER]: Becoming Leader. State: Replica: 92866fbb1dce4dc3bb0418f76985a488, State: Running, Role: LEADER
I20260805 22:54:33.503134 32496 consensus_queue.cc:237] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } }
I20260805 22:54:33.514441 31737 catalog_manager.cc:5495] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "92866fbb1dce4dc3bb0418f76985a488" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92866fbb1dce4dc3bb0418f76985a488" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 46597 } health_report { overall_health: HEALTHY } } }
I20260805 22:54:33.569851 32482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.561616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:39107 (local address 127.20.34.66:37907)
0805 22:54:33.561831 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.561837 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.562530 (+ 693us) server_negotiation.cc:407] Connection header received
0805 22:54:33.562767 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.562774 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.562897 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.563002 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:33.563839 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.565246 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.567461 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.568210 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.568366 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.568882 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:33.569070 (+ 188us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:33.569169 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.569353 (+ 184us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.569443 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 22:54:33.569868 32617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.561558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:37907 (local address 127.20.34.67:39107)
0805 22:54:33.562399 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:33.562420 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:33.562596 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:33.563087 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:33.563092 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:33.563107 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:54:33.563653 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.563671 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.565440 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.565446 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.567288 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.567306 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.568416 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.568423 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.568594 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.568672 (+ 78us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:54:33.569186 (+ 514us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:54:33.569209 (+ 23us) client_negotiation.cc:769] Sending connection context
0805 22:54:33.569303 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 22:54:33.569458 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":427,"threads_started":1}
I20260805 22:54:33.582058 31980 raft_consensus.cc:1261] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Refusing update from remote peer 92866fbb1dce4dc3bb0418f76985a488: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:33.582073 32185 raft_consensus.cc:1261] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Refusing update from remote peer 92866fbb1dce4dc3bb0418f76985a488: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:54:33.583040 32612 consensus_queue.cc:1035] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9531c68b152c46718ea31ae8ac90f73e" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 36863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:33.583873 32612 consensus_queue.cc:1035] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1314fe48a04f8fb891d67d4c9b98ff" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 37907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:54:33.643227 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.628971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:38553 (local address 127.20.34.67:46597)
0805 22:54:33.629180 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.629192 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.636942 (+ 7750us) server_negotiation.cc:407] Connection header received
0805 22:54:33.637174 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.637181 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.637303 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.637408 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:54:33.637980 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.639057 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.641133 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.641585 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.641692 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.642334 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:54:33.642489 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:54:33.642605 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.642767 (+ 162us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.642858 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 22:54:33.643313 32623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.628846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:46597 (local address 127.20.34.66:38553)
0805 22:54:33.636807 (+ 7961us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:33.636827 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:33.637006 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:33.637469 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:33.637474 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:33.637491 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 22:54:33.637795 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.637810 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.639213 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.639219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.640964 (+ 1745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:33.640981 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.641793 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.641800 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:33.642023 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.642081 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 22:54:33.642608 (+ 527us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 22:54:33.642623 (+ 15us) client_negotiation.cc:769] Sending connection context
0805 22:54:33.642736 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 22:54:33.642916 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7772,"thread_start_us":7582,"threads_started":1}
I20260805 22:54:33.677650 31737 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:33.677970 31737 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:54:33.681268 31737 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62ceb2a8836241409bf2b1466167d038: Sending DeleteTablet for 3 replicas of tablet 9810750644924d74b4224726ed00888b
I20260805 22:54:33.682210 32155 tablet_service.cc:1514] Processing DeleteTablet for tablet 9810750644924d74b4224726ed00888b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:37268
I20260805 22:54:33.682416 32355 tablet_service.cc:1514] Processing DeleteTablet for tablet 9810750644924d74b4224726ed00888b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:57292
I20260805 22:54:33.682546 31949 tablet_service.cc:1514] Processing DeleteTablet for tablet 9810750644924d74b4224726ed00888b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:54:33 UTC) from {username='oryx', principal='oryx/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:42808
I20260805 22:54:33.682832 32528 tablet_replica.cc:330] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: stopping tablet replica
I20260805 22:54:33.682864 32530 tablet_replica.cc:330] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: stopping tablet replica
I20260805 22:54:33.683027 32528 raft_consensus.cc:2229] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:33.683077 32530 raft_consensus.cc:2229] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:54:33.683193 32528 raft_consensus.cc:2258] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.683298 32530 raft_consensus.cc:2258] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.683473 32531 tablet_replica.cc:330] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: stopping tablet replica
I20260805 22:54:33.683676 32531 raft_consensus.cc:2229] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:54:33.683976 32531 raft_consensus.cc:2258] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:54:33.684351 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 31845
I20260805 22:54:33.685870 32528 ts_tablet_manager.cc:1905] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:33.689474 32530 ts_tablet_manager.cc:1905] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:54:33.689587 32531 ts_tablet_manager.cc:1905] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 05 22:54:33 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.65@KRBTEST.COM
I20260805 22:54:33.697947 32530 ts_tablet_manager.cc:1918] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:54:33.698141 32530 log.cc:1196] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/9810750644924d74b4224726ed00888b
I20260805 22:54:33.698706 32530 ts_tablet_manager.cc:1939] T 9810750644924d74b4224726ed00888b P 9531c68b152c46718ea31ae8ac90f73e: Deleting consensus metadata
I20260805 22:54:33.700146 31722 catalog_manager.cc:4841] TS 9531c68b152c46718ea31ae8ac90f73e (127.20.34.65:36863): tablet 9810750644924d74b4224726ed00888b (table test-table [id=f03824049ce648518341451657933821]) successfully deleted
I20260805 22:54:33.702646 32528 ts_tablet_manager.cc:1918] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:54:33.702839 32528 log.cc:1196] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/9810750644924d74b4224726ed00888b
I20260805 22:54:33.703275 32528 ts_tablet_manager.cc:1939] T 9810750644924d74b4224726ed00888b P fa1314fe48a04f8fb891d67d4c9b98ff: Deleting consensus metadata
I20260805 22:54:33.704522 32592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.685613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42812 (local address 127.20.34.65:36863)
0805 22:54:33.685788 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.685793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.685813 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:54:33.686050 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.686055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.686121 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.686181 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:33.687638 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.688550 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.690465 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.691164 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.691273 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.697323 (+ 6050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:33.697344 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:33.697363 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:33.697417 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:33.701234 (+ 3817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:33.702014 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:33.702025 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:33.702028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:33.702183 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:33.702605 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:33.702610 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:33.702614 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:33.703114 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:33.703498 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.703853 (+ 355us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.704084 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 22:54:33.704622 31723 catalog_manager.cc:4841] TS fa1314fe48a04f8fb891d67d4c9b98ff (127.20.34.66:37907): tablet 9810750644924d74b4224726ed00888b (table test-table [id=f03824049ce648518341451657933821]) successfully deleted
I20260805 22:54:33.705184 32043 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:33.706866 32531 ts_tablet_manager.cc:1918] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 22:54:33.707129 32531 log.cc:1196] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/9810750644924d74b4224726ed00888b
I20260805 22:54:33.707852 32531 ts_tablet_manager.cc:1939] T 9810750644924d74b4224726ed00888b P 92866fbb1dce4dc3bb0418f76985a488: Deleting consensus metadata
I20260805 22:54:33.709875 31721 catalog_manager.cc:4841] TS 92866fbb1dce4dc3bb0418f76985a488 (127.20.34.67:46597): tablet 9810750644924d74b4224726ed00888b (table test-table [id=f03824049ce648518341451657933821]) successfully deleted
I20260805 22:54:33.868889 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 31845
I20260805 22:54:33.901575 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 32060
Aug 05 22:54:33 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.66@KRBTEST.COM
I20260805 22:54:33.919871 32482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:33.902814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37300 (local address 127.20.34.66:37907)
0805 22:54:33.903042 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:33.903050 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:33.903103 (+ 53us) server_negotiation.cc:407] Connection header received
0805 22:54:33.903347 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:33.903354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:33.903448 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:33.903571 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:33.905038 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.906199 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.907540 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:33.908297 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:33.908454 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:33.913392 (+ 4938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:33.913412 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:33.913430 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:33.913483 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:33.916647 (+ 3164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:33.917581 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:33.917588 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:33.917591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:33.917734 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:33.918245 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:33.918251 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:33.918256 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:33.918670 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:33.918920 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:33.919356 (+ 436us) server_negotiation.cc:299] Negotiation successful
0805 22:54:33.919552 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260805 22:54:33.920629 32255 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:34.082579 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 32060
I20260805 22:54:34.082669 32631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:34.081841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:36863 (local address 127.20.34.66:55637)
0805 22:54:34.082334 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:34.082488 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:36863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":272,"threads_started":1}
I20260805 22:54:34.120644 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 32267
Aug 05 22:54:34 dist-test-slave-gmjp krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970473, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.34.67@KRBTEST.COM
I20260805 22:54:34.137658 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:34.121498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57312 (local address 127.20.34.67:46597)
0805 22:54:34.121767 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:34.121772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:34.121839 (+ 67us) server_negotiation.cc:407] Connection header received
0805 22:54:34.122047 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:34.122052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:34.122129 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:34.122222 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:34.123675 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:34.124633 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:34.126013 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:34.126457 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:34.126601 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:34.131667 (+ 5066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:34.131686 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:34.131704 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:34.131761 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:34.134729 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:34.135509 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:34.135516 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:34.135519 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:34.135661 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:34.136074 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:34.136077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:34.136079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:34.136534 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:34.136774 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:34.137069 (+ 295us) server_negotiation.cc:299] Negotiation successful
0805 22:54:34.137254 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:54:34.138530 32449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:34.288625 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 32267
I20260805 22:54:34.322181 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 31696
I20260805 22:54:34.323553 31800 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:34.447227 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 31696
2026-08-05T22:54:34Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7433 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:54:34 dist-test-slave-gmjp krb5kdc[32636](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:54:34 dist-test-slave-gmjp krb5kdc[32636](info): set up 2 sockets
Aug 05 22:54:34 dist-test-slave-gmjp krb5kdc[32636](info): commencing operation
krb5kdc: starting...
W20260805 22:54:35.785946 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:54:35 dist-test-slave-gmjp krb5kdc[32636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:54:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:54:36.108345 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:44073
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:44073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:36.487275 32653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:36.487583 32653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:36.487778 32653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:36.495328 32653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:36.495460 32653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:36.495573 32653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:36.495689 32653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:36.495770 32653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:36.507071 32653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:44073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:44073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:36.509091 32653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:36.510811 32653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:36.523475 32660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:36.523660 32659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:36.523674 32662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:36.524879 32653 server_base.cc:1034] running on GCE node
I20260805 22:54:36.525822 32653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:36.527488 32653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:36.528769 32653 hybrid_clock.cc:648] HybridClock initialized: now 1785970476528677 us; error 36 us; skew 500 ppm
I20260805 22:54:36.529151 32653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-05T22:54:36Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2153 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:54:36 dist-test-slave-gmjp krb5kdc[32674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:54:36 dist-test-slave-gmjp krb5kdc[32674](info): set up 2 sockets
Aug 05 22:54:36 dist-test-slave-gmjp krb5kdc[32674](info): commencing operation
krb5kdc: starting...
W20260805 22:54:37.944370 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:54:38 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:54:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:54:38.264530 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43635
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:43635
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:38.618427 32692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:38.618808 32692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:38.618976 32692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:38.626327 32692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:38.626484 32692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:38.626583 32692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:38.626677 32692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:38.626752 32692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:38.636759 32692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:43635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:38.638206 32692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:38.639611 32692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:38.652132 32698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:38.652200 32703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:38.652226 32699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:38.652961 32692 server_base.cc:1034] running on GCE node
I20260805 22:54:38.653784 32692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:38.655211 32692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:38.656415 32692 hybrid_clock.cc:648] HybridClock initialized: now 1785970478656356 us; error 47 us; skew 500 ppm
I20260805 22:54:38.656731 32692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:38 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970478, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:38.660138 32692 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:54:38.661808 32692 webserver.cc:460] Webserver started at http://127.20.34.126:36599/ using document root <none> and password file <none>
I20260805 22:54:38.662606 32692 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:38.662743 32692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:38.663103 32692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:38.666267 32692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "5a068dcd556c4c1daba46f2fbf20cb28"
format_stamp: "Formatted at 2026-08-05 22:54:38 on dist-test-slave-gmjp"
server_key: "653652408789019c43d91bc8cfe77ad9"
server_key_iv: "c9d02db73b4380bec18b3b277548d284"
server_key_version: "encryptionkey@0"
I20260805 22:54:38.667083 32692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "5a068dcd556c4c1daba46f2fbf20cb28"
format_stamp: "Formatted at 2026-08-05 22:54:38 on dist-test-slave-gmjp"
server_key: "653652408789019c43d91bc8cfe77ad9"
server_key_iv: "c9d02db73b4380bec18b3b277548d284"
server_key_version: "encryptionkey@0"
I20260805 22:54:38.672658 32692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260805 22:54:38.676270 32712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:38.677738 32692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:38.677954 32692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "5a068dcd556c4c1daba46f2fbf20cb28"
format_stamp: "Formatted at 2026-08-05 22:54:38 on dist-test-slave-gmjp"
server_key: "653652408789019c43d91bc8cfe77ad9"
server_key_iv: "c9d02db73b4380bec18b3b277548d284"
server_key_version: "encryptionkey@0"
I20260805 22:54:38.678221 32692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:38.694796 32692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:38.699090 32692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:38.699391 32692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:38.719568 32692 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:43635
I20260805 22:54:38.719570 309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:43635 every 8 connection(s)
I20260805 22:54:38.721181 32692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:38.724187 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 32692
I20260805 22:54:38.724413 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:38.725097 20617 external_mini_cluster.cc:1428] Setting key 4f1c786aada32bb669f331e2e5cd50f3
I20260805 22:54:38.725276 312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:38.739651 312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Bootstrap starting.
Aug 05 22:54:38 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:38.743705 312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:38.745188 312 log.cc:824] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:38.748929 312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: No bootstrap required, opened a new log
I20260805 22:54:38.750597 318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:38.727102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52936 (local address 127.20.34.126:43635)
0805 22:54:38.727881 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:38.727898 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:38.727957 (+ 59us) server_negotiation.cc:407] Connection header received
0805 22:54:38.730293 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:38.730324 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:38.730830 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:38.731280 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:38.732795 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:38.734738 (+ 1943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:38.736065 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:38.737220 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:38.737418 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:38.741350 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:38.741362 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:38.741382 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:38.741449 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:38.745627 (+ 4178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:38.746629 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:38.746635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:38.746642 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:38.746895 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:38.747271 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:38.747276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:38.747279 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:38.748040 (+ 761us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:38.748359 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:38.748746 (+ 387us) server_negotiation.cc:299] Negotiation successful
0805 22:54:38.749201 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":322,"threads_started":1}
I20260805 22:54:38.757858 312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } }
I20260805 22:54:38.758262 312 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:38.758342 312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a068dcd556c4c1daba46f2fbf20cb28, State: Initialized, Role: FOLLOWER
I20260805 22:54:38.758935 312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } }
I20260805 22:54:38.759156 312 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:38.759258 312 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:38.759397 312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:38.761737 312 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } }
I20260805 22:54:38.762393 312 leader_election.cc:302] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a068dcd556c4c1daba46f2fbf20cb28; no voters:
I20260805 22:54:38.763016 312 leader_election.cc:288] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:38.763167 321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:38.763919 321 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 1 LEADER]: Becoming Leader. State: Replica: 5a068dcd556c4c1daba46f2fbf20cb28, State: Running, Role: LEADER
I20260805 22:54:38.764462 321 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } }
I20260805 22:54:38.765224 312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:38.768673 325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a068dcd556c4c1daba46f2fbf20cb28. Latest consensus state: current_term: 1 leader_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } } }
I20260805 22:54:38.769163 325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:38.769729 324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } } }
I20260805 22:54:38.770094 324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:38.771512 333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:38.776882 333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:38.786206 333 catalog_manager.cc:1347] Generated new cluster ID: 6c050b999fee42fa907418ffd2bb5d01
I20260805 22:54:38.786338 333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:38.798877 333 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:38.800926 333 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:38.810948 333 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Generated new TSK 0
I20260805 22:54:38.812090 333 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:54:38.886513 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43635
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:39.264009 351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:39.264477 351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:39.264662 351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:39.273983 351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:39.274161 351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:39.274351 351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:54:39.286398 351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:39.287894 351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:39.289371 351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:39.303597 360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:39.303709 363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:39.303642 361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:39.304597 351 server_base.cc:1034] running on GCE node
I20260805 22:54:39.305212 351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:39.306182 351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:39.307390 351 hybrid_clock.cc:648] HybridClock initialized: now 1785970479307344 us; error 33 us; skew 500 ppm
I20260805 22:54:39.307749 351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:39 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970479, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:39.311420 351 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:54:39.313117 351 webserver.cc:460] Webserver started at http://127.20.34.65:37091/ using document root <none> and password file <none>
I20260805 22:54:39.313868 351 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:39.314014 351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:39.314352 351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:39.317473 351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "e73778261550446b972f5e1254913c9d"
format_stamp: "Formatted at 2026-08-05 22:54:39 on dist-test-slave-gmjp"
server_key: "dded7ca4273445d8a164ff164cec844d"
server_key_iv: "afdab86baaf5360700f6b09faa3ed12d"
server_key_version: "encryptionkey@0"
I20260805 22:54:39.318349 351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "e73778261550446b972f5e1254913c9d"
format_stamp: "Formatted at 2026-08-05 22:54:39 on dist-test-slave-gmjp"
server_key: "dded7ca4273445d8a164ff164cec844d"
server_key_iv: "afdab86baaf5360700f6b09faa3ed12d"
server_key_version: "encryptionkey@0"
I20260805 22:54:39.324041 351 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:54:39.327852 377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:39.329461 351 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:54:39.329663 351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "e73778261550446b972f5e1254913c9d"
format_stamp: "Formatted at 2026-08-05 22:54:39 on dist-test-slave-gmjp"
server_key: "dded7ca4273445d8a164ff164cec844d"
server_key_iv: "afdab86baaf5360700f6b09faa3ed12d"
server_key_version: "encryptionkey@0"
I20260805 22:54:39.329900 351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:39.342821 351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:39.347188 351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:39.347518 351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:39.348598 351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:39.350119 351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:39.350222 351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:39.350378 351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:39.350449 351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:39.386626 351 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34481
I20260805 22:54:39.386672 537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34481 every 8 connection(s)
I20260805 22:54:39.388031 351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:54:39.390473 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 351
I20260805 22:54:39.390718 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:54:39.391626 20617 external_mini_cluster.cc:1428] Setting key f7c7568e0d1e6ff28b4ed53c66c6ae67
Aug 05 22:54:39 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970479, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:39.410105 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:39.391110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:54349 (local address 127.20.34.126:43635)
0805 22:54:39.391621 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:39.391626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:39.392994 (+ 1368us) server_negotiation.cc:407] Connection header received
0805 22:54:39.395111 (+ 2117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:39.395117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:39.395229 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:39.395361 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:39.397056 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:39.397823 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:39.399436 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:39.399877 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:39.400013 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:39.403891 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:39.403897 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:39.403900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:39.403935 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:39.406696 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:39.407533 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:39.407537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:39.407540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:39.407664 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:39.408125 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:39.408130 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:39.408132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:39.408493 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:39.408657 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:39.409449 (+ 792us) server_negotiation.cc:299] Negotiation successful
0805 22:54:39.409707 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":279,"threads_started":1}
I20260805 22:54:39.411149 545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:39.391873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:54349)
0805 22:54:39.392835 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:39.392877 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:39.394830 (+ 1953us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:39.395623 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:39.395632 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:39.396259 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:39.396877 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:39.396895 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:39.397990 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:39.397994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:39.399280 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:39.399298 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:39.400129 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:39.400137 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:39.400408 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:39.401126 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:39.401156 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:39.403649 (+ 2493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:39.406860 (+ 3211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:39.406869 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:39.406889 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:39.407381 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:39.407782 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:39.407788 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:39.407792 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:39.407998 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:39.408649 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:39.408658 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:39.409038 (+ 380us) client_negotiation.cc:769] Sending connection context
0805 22:54:39.409325 (+ 287us) client_negotiation.cc:240] Negotiation successful
0805 22:54:39.409925 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":379,"threads_started":1}
I20260805 22:54:39.413087 541 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43635
I20260805 22:54:39.413471 541 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:39.414402 541 heartbeater.cc:511] Master 127.20.34.126:43635 requested a full tablet report, sending...
I20260805 22:54:39.417016 32731 ts_manager.cc:194] Registered new tserver with Master: e73778261550446b972f5e1254913c9d (127.20.34.65:34481)
I20260805 22:54:39.419335 32731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:54349
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:54:39.461563 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43635
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:39.827744 548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:39.828056 548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:39.828210 548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:39.835965 548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:39.836102 548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:39.836284 548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:54:39.846561 548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:39.847992 548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:39.849486 548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:39.863513 562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:39.863476 564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:39.863571 561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:39.864456 548 server_base.cc:1034] running on GCE node
I20260805 22:54:39.865139 548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:39.866276 548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:39.867542 548 hybrid_clock.cc:648] HybridClock initialized: now 1785970479867487 us; error 52 us; skew 500 ppm
I20260805 22:54:39.867902 548 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:39 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970479, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:39.871546 548 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:54:39.873253 548 webserver.cc:460] Webserver started at http://127.20.34.66:43379/ using document root <none> and password file <none>
I20260805 22:54:39.873993 548 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:39.874125 548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:39.874468 548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:39.877796 548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "6b04310fa4a54d3a958a6143643723aa"
format_stamp: "Formatted at 2026-08-05 22:54:39 on dist-test-slave-gmjp"
server_key: "5d7d4f75ed2b7a4d0b607350c805a723"
server_key_iv: "a248b9d2a2bf81914999cfcb5cd77650"
server_key_version: "encryptionkey@0"
I20260805 22:54:39.878705 548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "6b04310fa4a54d3a958a6143643723aa"
format_stamp: "Formatted at 2026-08-05 22:54:39 on dist-test-slave-gmjp"
server_key: "5d7d4f75ed2b7a4d0b607350c805a723"
server_key_iv: "a248b9d2a2bf81914999cfcb5cd77650"
server_key_version: "encryptionkey@0"
I20260805 22:54:39.884568 548 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:54:39.888480 572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:39.889961 548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:39.890153 548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "6b04310fa4a54d3a958a6143643723aa"
format_stamp: "Formatted at 2026-08-05 22:54:39 on dist-test-slave-gmjp"
server_key: "5d7d4f75ed2b7a4d0b607350c805a723"
server_key_iv: "a248b9d2a2bf81914999cfcb5cd77650"
server_key_version: "encryptionkey@0"
I20260805 22:54:39.890378 548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:39.907464 548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:39.912334 548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:39.912649 548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:39.913690 548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:39.915158 548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:39.915261 548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:39.915413 548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:39.915488 548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:39.950582 548 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:35409
I20260805 22:54:39.950621 729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:35409 every 8 connection(s)
I20260805 22:54:39.951926 548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:54:39.954103 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 548
I20260805 22:54:39.954299 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:54:39.954774 20617 external_mini_cluster.cc:1428] Setting key 7757655fc7015067214a597ae22f8d09
Aug 05 22:54:39 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970479, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:39.975268 734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:39.954996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:54823 (local address 127.20.34.126:43635)
0805 22:54:39.955519 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:39.955529 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:39.956944 (+ 1415us) server_negotiation.cc:407] Connection header received
0805 22:54:39.958624 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:39.958632 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:39.958746 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:39.958872 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:39.960440 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:39.961602 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:39.963279 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:39.964049 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:39.964227 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:39.968335 (+ 4108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:39.968345 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:39.968353 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:39.968404 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:39.972073 (+ 3669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:39.972871 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:39.972876 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:39.972878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:39.973020 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:39.973469 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:39.973473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:39.973475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:39.973757 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:39.973913 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:39.974653 (+ 740us) server_negotiation.cc:299] Negotiation successful
0805 22:54:39.974887 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":248,"threads_started":1}
I20260805 22:54:39.976400 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:39.955605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:54823)
0805 22:54:39.956549 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:39.956597 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:39.958338 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:39.959084 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:39.959091 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:39.959607 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:39.960264 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:39.960285 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:39.961775 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:39.961778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:39.963110 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:39.963124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:39.964352 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:39.964358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:39.964597 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:39.965415 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:39.965440 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:39.968028 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:39.972246 (+ 4218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:39.972257 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:39.972279 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:39.972726 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:39.973137 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:39.973143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:39.973150 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:39.973342 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:39.973895 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:39.973903 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:39.974273 (+ 370us) client_negotiation.cc:769] Sending connection context
0805 22:54:39.974551 (+ 278us) client_negotiation.cc:240] Negotiation successful
0805 22:54:39.975130 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":377,"threads_started":1}
I20260805 22:54:39.977938 730 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43635
I20260805 22:54:39.978312 730 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:39.979285 730 heartbeater.cc:511] Master 127.20.34.126:43635 requested a full tablet report, sending...
I20260805 22:54:39.981187 32731 ts_manager.cc:194] Registered new tserver with Master: 6b04310fa4a54d3a958a6143643723aa (127.20.34.66:35409)
I20260805 22:54:39.982617 32731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:54823
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:54:40.025578 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43635
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:40.394910 742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:40.395325 742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:40.395507 742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:40.403291 742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:40.403474 742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:40.403667 742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:54:40.414352 742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:40.415863 742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:40.417347 742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 22:54:40.422801 541 heartbeater.cc:503] Master 127.20.34.126:43635 was elected leader, sending a full tablet report...
W20260805 22:54:40.431965 749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:40.431942 750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:40.431915 752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:40.433244 742 server_base.cc:1034] running on GCE node
I20260805 22:54:40.433961 742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:40.435082 742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:40.436290 742 hybrid_clock.cc:648] HybridClock initialized: now 1785970480436232 us; error 64 us; skew 500 ppm
I20260805 22:54:40.436623 742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:40 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970480, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:40.439941 742 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:54:40.441694 742 webserver.cc:460] Webserver started at http://127.20.34.67:40751/ using document root <none> and password file <none>
I20260805 22:54:40.442399 742 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:40.442504 742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:40.442775 742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:40.446010 742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "c0c2cd852df345819fe8f7da428c30bb"
format_stamp: "Formatted at 2026-08-05 22:54:40 on dist-test-slave-gmjp"
server_key: "c4d7c8df1ec60a5b71a2d0af23a47017"
server_key_iv: "77ca80a3e12a5f2b2d16c9c765b69399"
server_key_version: "encryptionkey@0"
I20260805 22:54:40.447105 742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "c0c2cd852df345819fe8f7da428c30bb"
format_stamp: "Formatted at 2026-08-05 22:54:40 on dist-test-slave-gmjp"
server_key: "c4d7c8df1ec60a5b71a2d0af23a47017"
server_key_iv: "77ca80a3e12a5f2b2d16c9c765b69399"
server_key_version: "encryptionkey@0"
I20260805 22:54:40.452890 742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260805 22:54:40.456745 761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:40.458218 742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260805 22:54:40.458415 742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "c0c2cd852df345819fe8f7da428c30bb"
format_stamp: "Formatted at 2026-08-05 22:54:40 on dist-test-slave-gmjp"
server_key: "c4d7c8df1ec60a5b71a2d0af23a47017"
server_key_iv: "77ca80a3e12a5f2b2d16c9c765b69399"
server_key_version: "encryptionkey@0"
I20260805 22:54:40.458658 742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:40.485237 742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:40.489820 742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:40.490176 742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:40.491281 742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:40.492865 742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:40.492988 742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:40.493145 742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:40.493218 742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:40.531052 742 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:39759
I20260805 22:54:40.531114 912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:39759 every 8 connection(s)
I20260805 22:54:40.532539 742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:54:40.540360 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 742
I20260805 22:54:40.540571 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:54:40.541152 20617 external_mini_cluster.cc:1428] Setting key eefde2f534ec20715b88fa85098e5a3d
Aug 05 22:54:40 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970480, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:54:40.552937 916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:40.535309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:37117 (local address 127.20.34.126:43635)
0805 22:54:40.535795 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:40.535800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:40.536681 (+ 881us) server_negotiation.cc:407] Connection header received
0805 22:54:40.538712 (+ 2031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:40.538719 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:40.538829 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:40.538952 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:40.540974 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:40.541831 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:40.543475 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:40.543912 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:40.544052 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:40.547544 (+ 3492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:40.547550 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:40.547553 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:40.547594 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:40.550123 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:40.550825 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:40.550829 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:40.550831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:40.550962 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:40.551350 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:40.551353 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:40.551355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:40.551616 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:40.551733 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:40.552479 (+ 746us) server_negotiation.cc:299] Negotiation successful
0805 22:54:40.552655 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":242,"threads_started":1}
I20260805 22:54:40.553920 918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:40.535765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:37117)
0805 22:54:40.536515 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:40.536554 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:40.538398 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:40.539209 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:40.539217 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:40.539780 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:40.540735 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:40.540768 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:40.542023 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:40.542029 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:40.543308 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:40.543321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:40.544171 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:40.544180 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:40.544441 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:40.545083 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:40.545108 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:40.547336 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:54:40.550261 (+ 2925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:40.550268 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:40.550282 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:40.550718 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:40.551055 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:54:40.551058 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:54:40.551061 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:54:40.551254 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:54:40.551724 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:54:40.551730 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:54:40.552067 (+ 337us) client_negotiation.cc:769] Sending connection context
0805 22:54:40.552371 (+ 304us) client_negotiation.cc:240] Negotiation successful
0805 22:54:40.552782 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":321,"threads_started":1}
I20260805 22:54:40.555402 913 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43635
I20260805 22:54:40.555768 913 heartbeater.cc:464] Registering TS with master...
I20260805 22:54:40.556730 913 heartbeater.cc:511] Master 127.20.34.126:43635 requested a full tablet report, sending...
I20260805 22:54:40.558158 32731 ts_manager.cc:194] Registered new tserver with Master: c0c2cd852df345819fe8f7da428c30bb (127.20.34.67:39759)
I20260805 22:54:40.558991 32731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:37117
I20260805 22:54:40.569489 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab.
Entry for principal oryx/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab.
WARNING: no policy specified for oryx/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab.
Entry for principal oryx/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab.
WARNING: no policy specified for oryx/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab.
Entry for principal oryx/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab.
I20260805 22:54:40.768224 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 351
Aug 05 22:54:40 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:54:40.786507 932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:40.769557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41362 (local address 127.20.34.65:34481)
0805 22:54:40.770278 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:40.770286 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:40.770319 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:54:40.770386 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:40.770393 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:40.770623 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:40.770772 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:40.772328 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:40.773418 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:40.774650 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:40.775269 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:40.775377 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:40.779832 (+ 4455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:40.779851 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:40.779869 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:40.779915 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:40.783078 (+ 3163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:40.783880 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:40.783890 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:40.783892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:40.784086 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:40.784594 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:40.784599 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:40.784601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:40.785045 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:40.785309 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:40.785703 (+ 394us) server_negotiation.cc:299] Negotiation successful
0805 22:54:40.786043 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":346,"threads_started":1}
I20260805 22:54:40.788529 531 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:40.880744 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 351
I20260805 22:54:40.907843 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 548
Aug 05 22:54:40 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:54:40.924376 934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:40.908829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53586 (local address 127.20.34.66:35409)
0805 22:54:40.909379 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:40.909387 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:40.909414 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:54:40.909477 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:40.909483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:40.909696 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:40.909869 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:40.911188 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:40.912326 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:40.913566 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:40.914132 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:40.914283 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:40.918684 (+ 4401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:40.918698 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:40.918714 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:40.918753 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:40.921609 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:40.922305 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:40.922323 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:40.922326 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:40.922471 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:40.922798 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:40.922801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:40.922803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:40.923162 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:40.923449 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:40.923659 (+ 210us) server_negotiation.cc:299] Negotiation successful
0805 22:54:40.923892 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":263,"threads_started":1}
I20260805 22:54:40.925843 724 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:41.009654 730 heartbeater.cc:503] Master 127.20.34.126:43635 was elected leader, sending a full tablet report...
I20260805 22:54:41.011610 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 548
I20260805 22:54:41.035230 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 742
Aug 05 22:54:41 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:54:41.052404 939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:41.036428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49276 (local address 127.20.34.67:39759)
0805 22:54:41.036996 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:41.037004 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:41.037046 (+ 42us) server_negotiation.cc:407] Connection header received
0805 22:54:41.037110 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:41.037116 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:41.037357 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:41.037488 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:41.038816 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:41.039807 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:41.041190 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:41.041801 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:41.041911 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:41.046621 (+ 4710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:41.046637 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:41.046654 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:41.046694 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:41.049596 (+ 2902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:41.050303 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:41.050311 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:41.050322 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:41.050448 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:41.050782 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:41.050785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:41.050787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:41.051155 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:41.051508 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:41.051730 (+ 222us) server_negotiation.cc:299] Negotiation successful
0805 22:54:41.052020 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":263,"threads_started":1}
I20260805 22:54:41.053993 908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:41.141987 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 742
I20260805 22:54:41.165381 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 32692
I20260805 22:54:41.166715 303 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:41.275905 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 32692
I20260805 22:54:41.303411 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43635
--webserver_interface=127.20.34.126
--webserver_port=36599
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:43635
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:54:41.672040 942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:41.672411 942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:41.672618 942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:41.680178 942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:41.680356 942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:41.680469 942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:41.680572 942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:41.680658 942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:41.691272 942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:43635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=36599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:41.693001 942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:41.694535 942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:41.707803 950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:41.707929 947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:41.707916 948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:41.708928 942 server_base.cc:1034] running on GCE node
I20260805 22:54:41.709800 942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:41.711408 942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:41.712632 942 hybrid_clock.cc:648] HybridClock initialized: now 1785970481712588 us; error 33 us; skew 500 ppm
I20260805 22:54:41.713061 942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:41 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970481, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:41.720701 942 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:54:41.722653 942 webserver.cc:460] Webserver started at http://127.20.34.126:36599/ using document root <none> and password file <none>
I20260805 22:54:41.723479 942 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:41.723667 942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:41.730432 942 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260805 22:54:41.733603 960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:41.735054 942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 22:54:41.735251 942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "5a068dcd556c4c1daba46f2fbf20cb28"
format_stamp: "Formatted at 2026-08-05 22:54:38 on dist-test-slave-gmjp"
server_key: "653652408789019c43d91bc8cfe77ad9"
server_key_iv: "c9d02db73b4380bec18b3b277548d284"
server_key_version: "encryptionkey@0"
I20260805 22:54:41.736369 942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:41.754717 942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:41.759232 942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:41.759488 942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:41.779827 942 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:43635
I20260805 22:54:41.779853 1041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:43635 every 8 connection(s)
I20260805 22:54:41.781558 942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:41.785954 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 942
I20260805 22:54:41.786854 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:34481
--local_ip_for_outbound_sockets=127.20.34.65
--tserver_master_addrs=127.20.34.126:43635
--webserver_port=37091
--webserver_interface=127.20.34.65
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.34.65
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:54:41.789235 1042 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:54:41.792837 1042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Bootstrap starting.
I20260805 22:54:41.814081 1042 log.cc:824] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:41.823944 1042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:54:41.824587 1042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Bootstrap complete.
I20260805 22:54:41.834335 1042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } }
I20260805 22:54:41.835316 1042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a068dcd556c4c1daba46f2fbf20cb28, State: Initialized, Role: FOLLOWER
I20260805 22:54:41.835997 1042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } }
I20260805 22:54:41.836333 1042 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:41.836488 1042 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:41.836688 1042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:54:41.841262 1042 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } }
I20260805 22:54:41.841843 1042 leader_election.cc:302] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a068dcd556c4c1daba46f2fbf20cb28; no voters:
I20260805 22:54:41.842567 1042 leader_election.cc:288] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:54:41.842722 1047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:54:41.844430 1047 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [term 2 LEADER]: Becoming Leader. State: Replica: 5a068dcd556c4c1daba46f2fbf20cb28, State: Running, Role: LEADER
I20260805 22:54:41.845160 1047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } }
I20260805 22:54:41.845428 1042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:41.848245 1050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a068dcd556c4c1daba46f2fbf20cb28. Latest consensus state: current_term: 2 leader_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } } }
I20260805 22:54:41.848307 1049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a068dcd556c4c1daba46f2fbf20cb28" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43635 } } }
I20260805 22:54:41.848706 1050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:41.848788 1049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:41.849784 1056 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:41.865559 1056 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:41.867826 1056 catalog_manager.cc:1259] Loaded cluster ID: 6c050b999fee42fa907418ffd2bb5d01
I20260805 22:54:41.868098 1056 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:41.873632 1056 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:41.876121 1056 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5a068dcd556c4c1daba46f2fbf20cb28: Loaded TSK: 0
I20260805 22:54:41.878563 1056 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:54:42.181571 1045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:42.181934 1045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:42.182089 1045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:42.189797 1045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:42.189909 1045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:42.190083 1045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:54:42.200901 1045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.65.keytab
--principal=oryx/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:34481
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=37091
--tserver_master_addrs=127.20.34.126:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:42.202368 1045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:42.203816 1045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:42.219467 1080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:42.219802 1081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:42.220605 1084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:42.220920 1045 server_base.cc:1034] running on GCE node
I20260805 22:54:42.221742 1045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:42.222978 1045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:42.224231 1045 hybrid_clock.cc:648] HybridClock initialized: now 1785970482224179 us; error 46 us; skew 500 ppm
I20260805 22:54:42.224682 1045 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:42 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970482, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:42.228915 1045 init.cc:377] Logged in from keytab as oryx/127.20.34.65@KRBTEST.COM (short username oryx)
I20260805 22:54:42.230829 1045 webserver.cc:460] Webserver started at http://127.20.34.65:37091/ using document root <none> and password file <none>
I20260805 22:54:42.231727 1045 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:42.231884 1045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:42.238817 1045 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260805 22:54:42.242199 1092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:42.243646 1045 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:54:42.243851 1045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "e73778261550446b972f5e1254913c9d"
format_stamp: "Formatted at 2026-08-05 22:54:39 on dist-test-slave-gmjp"
server_key: "dded7ca4273445d8a164ff164cec844d"
server_key_iv: "afdab86baaf5360700f6b09faa3ed12d"
server_key_version: "encryptionkey@0"
I20260805 22:54:42.245021 1045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:42.275633 1045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:42.279908 1045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:42.280246 1045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:42.281368 1045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:42.282887 1045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:42.282985 1045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:42.283130 1045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:42.283234 1045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:42.320863 1045 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34481
I20260805 22:54:42.320947 1264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34481 every 8 connection(s)
I20260805 22:54:42.322472 1045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:54:42.332521 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 1045
I20260805 22:54:42.333192 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:35409
--local_ip_for_outbound_sockets=127.20.34.66
--tserver_master_addrs=127.20.34.126:43635
--webserver_port=43379
--webserver_interface=127.20.34.66
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.34.66
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:54:42 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:42 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:54:42.703908 1271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:42.704272 1271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:42.704445 1271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:42.711982 1271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:42.712122 1271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:42.712411 1271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:54:42.722833 1271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.66.keytab
--principal=oryx/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:35409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=43379
--tserver_master_addrs=127.20.34.126:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:42.724334 1271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:42.725734 1271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:42.743186 1278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:42.743196 1279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:42.743966 1281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:42.744392 1271 server_base.cc:1034] running on GCE node
I20260805 22:54:42.745188 1271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:42.746505 1271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:42.747752 1271 hybrid_clock.cc:648] HybridClock initialized: now 1785970482747713 us; error 53 us; skew 500 ppm
I20260805 22:54:42.748136 1271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:42 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970482, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:42.751801 1271 init.cc:377] Logged in from keytab as oryx/127.20.34.66@KRBTEST.COM (short username oryx)
I20260805 22:54:42.753736 1271 webserver.cc:460] Webserver started at http://127.20.34.66:43379/ using document root <none> and password file <none>
I20260805 22:54:42.754503 1271 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:42.754673 1271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:42.760860 1271 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260805 22:54:42.763944 1290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:42.765610 1271 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 22:54:42.765800 1271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "6b04310fa4a54d3a958a6143643723aa"
format_stamp: "Formatted at 2026-08-05 22:54:39 on dist-test-slave-gmjp"
server_key: "5d7d4f75ed2b7a4d0b607350c805a723"
server_key_iv: "a248b9d2a2bf81914999cfcb5cd77650"
server_key_version: "encryptionkey@0"
I20260805 22:54:42.766867 1271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:42.837706 1271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:42.842813 1271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:42.843130 1271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:42.844400 1271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:54:42.846200 1271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:42.846328 1271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:42.846479 1271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:42.846589 1271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:42.891547 1271 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:35409
I20260805 22:54:42.891602 1454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:35409 every 8 connection(s)
I20260805 22:54:42.893399 1271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:54:42.900275 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 1271
I20260805 22:54:42.901094 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:39759
--local_ip_for_outbound_sockets=127.20.34.67
--tserver_master_addrs=127.20.34.126:43635
--webserver_port=40751
--webserver_interface=127.20.34.67
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.34.67
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:54:42 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:42 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:54:43.576341 1463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:43.576649 1463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:43.576817 1463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:43.584856 1463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:43.585021 1463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:43.585268 1463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:54:43.597002 1463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/krb5kdc/oryx_127.20.34.67.keytab
--principal=oryx/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:39759
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=40751
--tserver_master_addrs=127.20.34.126:43635
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:43.598681 1463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:43.600302 1463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:43.623283 1473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:43.623345 1474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:43.624571 1476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:43.628659 1463 server_base.cc:1034] running on GCE node
I20260805 22:54:43.629585 1463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:43.630955 1463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:43.632265 1463 hybrid_clock.cc:648] HybridClock initialized: now 1785970483632194 us; error 56 us; skew 500 ppm
I20260805 22:54:43.632709 1463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:54:43 dist-test-slave-gmjp krb5kdc[32674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970483, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:54:43.637173 1463 init.cc:377] Logged in from keytab as oryx/127.20.34.67@KRBTEST.COM (short username oryx)
I20260805 22:54:43.640573 1463 webserver.cc:460] Webserver started at http://127.20.34.67:40751/ using document root <none> and password file <none>
I20260805 22:54:43.642217 1463 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:43.642477 1463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:43.654223 1463 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.005s sys 0.001s
I20260805 22:54:43.659601 1486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:43.662264 1463 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260805 22:54:43.662595 1463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "c0c2cd852df345819fe8f7da428c30bb"
format_stamp: "Formatted at 2026-08-05 22:54:40 on dist-test-slave-gmjp"
server_key: "c4d7c8df1ec60a5b71a2d0af23a47017"
server_key_iv: "77ca80a3e12a5f2b2d16c9c765b69399"
server_key_version: "encryptionkey@0"
I20260805 22:54:43.664894 1463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260805 22:54:43.702945 1270 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.365s user 0.004s sys 0.015s
I20260805 22:54:43.705103 1270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:42.326070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:54151)
0805 22:54:42.326996 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:42.327044 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:42.328952 (+ 1908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:42.330481 (+ 1529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:42.330494 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:42.331191 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:42.331744 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:42.331761 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:42.333796 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:42.333804 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:42.336089 (+ 2285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:42.336110 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:42.337195 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:42.337205 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:42.337522 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:42.338318 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:42.338355 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:43.703847 (+1365492us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":410,"threads_started":1}
W20260805 22:54:43.705111 1268 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:42.325945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:54151 (local address 127.20.34.126:43635)
0805 22:54:42.326833 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:42.326849 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:42.327183 (+ 334us) server_negotiation.cc:407] Connection header received
0805 22:54:42.329528 (+ 2345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:42.329540 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:42.329900 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:42.330314 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:42.332040 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:42.333612 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:42.336279 (+ 2667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:42.336932 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:42.337081 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:43.704321 (+1367240us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:54151: BlockingRecv error: recv got EOF from 127.20.34.65:54151 (error 108)
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":282,"threads_started":1}
I20260805 22:54:43.705967 1463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
W20260805 22:54:43.706449 1266 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:43635 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.34.126:43635: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
I20260805 22:54:43.715070 1463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:43.715426 1463 kserver.cc:163] Server-wide thread pool size limit: 3276
Aug 05 22:54:43 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:43.717712 1463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
Aug 05 22:54:43 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:43.720829 1463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:54:43.720978 1463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 22:54:43.721115 1463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:54:43.721163 1270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:43.707269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:57343)
0805 22:54:43.707477 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:43.707500 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:43.707631 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:43.708420 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:43.708426 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:43.708808 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:43.708983 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:43.708992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.710135 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.710146 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:43.712583 (+ 2437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:43.712608 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.714059 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.714067 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:43.714258 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:43.715014 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:43.715044 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:43.720802 (+ 5758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":74}
I20260805 22:54:43.721222 1463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260805 22:54:43.721623 1268 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:43.707581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:57343 (local address 127.20.34.126:43635)
0805 22:54:43.708048 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:43.708053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:43.708070 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:54:43.708127 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:43.708130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:43.708266 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:43.708383 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:43.709144 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.709926 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.712841 (+ 2915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.713828 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.714008 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:43.721237 (+ 7229us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:57343: BlockingRecv error: recv got EOF from 127.20.34.65:57343 (error 108)
Metrics: {"server-negotiator.queue_time_us":374}
Aug 05 22:54:43 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:43 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:43.738627 1270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:43.722164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:49537)
0805 22:54:43.722857 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:43.722883 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:43.723044 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:43.723660 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:43.723666 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:43.724104 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:43.724370 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:43.724388 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.726599 (+ 2211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.726611 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:43.729030 (+ 2419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:43.729054 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.730736 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.730747 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:43.731105 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:43.732105 (+ 1000us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:43.732142 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:43.738179 (+ 6037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512}
W20260805 22:54:43.738999 1268 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:43.722412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:49537 (local address 127.20.34.126:43635)
0805 22:54:43.722649 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:43.722658 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:43.722986 (+ 328us) server_negotiation.cc:407] Connection header received
0805 22:54:43.723215 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:43.723224 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:43.723348 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:43.723495 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:43.724564 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.726320 (+ 1756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.729304 (+ 2984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.730318 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.730508 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:43.738635 (+ 8127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:49537: BlockingRecv error: recv got EOF from 127.20.34.65:49537 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260805 22:54:43.739332 1266 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:54:43.790448 1463 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:39759
I20260805 22:54:43.790480 1663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:39759 every 8 connection(s)
I20260805 22:54:43.792034 1463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:54:43.794916 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 1463
Aug 05 22:54:43 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:43 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:43.818320 1669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:43.797622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40692 (local address 127.20.34.126:43635)
0805 22:54:43.798302 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:43.798310 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:43.798340 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:54:43.798405 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:43.798411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:43.798514 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:43.801103 (+ 2589us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:43.801421 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.802703 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.805593 (+ 2890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.806211 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.806371 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:43.810783 (+ 4412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:43.810798 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:43.810824 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:43.810895 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:43.814480 (+ 3585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:43.815347 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:43.815356 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:43.815364 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:43.815595 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:54:43.816046 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:54:43.816050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:54:43.816052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:54:43.816647 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:43.817006 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:43.817526 (+ 520us) server_negotiation.cc:299] Negotiation successful
0805 22:54:43.817973 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":547,"spinlock_wait_cycles":21760,"thread_start_us":1961,"threads_started":1}
W20260805 22:54:44.059494 1462 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.149s user 0.005s sys 0.011s
W20260805 22:54:44.061317 1461 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:42.896447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:59411 (local address 127.20.34.126:43635)
0805 22:54:42.897096 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:42.897108 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:42.898205 (+ 1097us) server_negotiation.cc:407] Connection header received
0805 22:54:42.900429 (+ 2224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:42.900439 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:42.900572 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:42.900744 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:42.903408 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:42.905312 (+ 1904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:42.908009 (+ 2697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:42.909083 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:42.909280 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.060914 (+1151634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:59411: BlockingRecv error: recv got EOF from 127.20.34.66:59411 (error 108)
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":282,"threads_started":1}
I20260805 22:54:44.061869 1462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:42.897065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:59411)
0805 22:54:42.897989 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:42.898050 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:42.900024 (+ 1974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:42.901064 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:42.901078 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:42.902198 (+ 1120us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:42.903119 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:42.903155 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:42.905568 (+ 2413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:42.905576 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:42.907786 (+ 2210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:42.907805 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:42.909384 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:42.909395 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:42.909747 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:42.910641 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:42.910679 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:44.060613 (+1149934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":392,"threads_started":1}
W20260805 22:54:44.063239 1455 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:43635 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.34.126:43635: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:54:44.076267 1461 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:44.064287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:44991 (local address 127.20.34.126:43635)
0805 22:54:44.064489 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:44.064495 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:44.064513 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:54:44.064661 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:44.064666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:44.064740 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:44.064847 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:44.065680 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.066969 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.068405 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.068827 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.068989 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.075959 (+ 6970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:44991: BlockingRecv error: recv got EOF from 127.20.34.66:44991 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:54:44.076297 1462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:44.064120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:44991)
0805 22:54:44.064360 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:44.064384 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:44.064510 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:44.064888 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:44.064895 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:44.065288 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:44.065497 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.065511 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.067145 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.067151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.068239 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.068257 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.069027 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.069035 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.069221 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.070230 (+ 1009us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:44.070265 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:44.075738 (+ 5473us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":79}
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:54:44.090524 1461 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:44.077863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:42177 (local address 127.20.34.126:43635)
0805 22:54:44.078136 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:44.078146 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:44.078174 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:54:44.078263 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:44.078271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:44.078387 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:44.078556 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:44.079319 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.081203 (+ 1884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.082639 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.083729 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.083937 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.090312 (+ 6375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:42177: BlockingRecv error: recv got EOF from 127.20.34.66:42177 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:54:44.090586 1462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:44.077471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:42177)
0805 22:54:44.077679 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:44.077702 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:44.077834 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:44.078618 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:44.078622 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:44.078965 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:44.079150 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.079160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.081414 (+ 2254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.081418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.082453 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.082467 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.083955 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.083960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.084123 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.085047 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:44.085069 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:44.090142 (+ 5073us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":81}
W20260805 22:54:44.091073 1455 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:44.754983 1677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:44.740254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:57521)
0805 22:54:44.742085 (+ 1831us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:44.742116 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:44.742270 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:44.743030 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:44.743034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:44.743584 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:44.743754 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.743763 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.745922 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.745927 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.747065 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.747082 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.748525 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.748531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.748725 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.749621 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:44.749650 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:44.754738 (+ 5088us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1637,"thread_start_us":1430,"threads_started":1}
W20260805 22:54:44.755573 1673 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:44.740255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:57521 (local address 127.20.34.126:43635)
0805 22:54:44.742564 (+ 2309us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:44.742575 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:44.742606 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:54:44.742691 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:44.742700 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:44.742811 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:44.742989 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:44.743950 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.745725 (+ 1775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.747257 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.748303 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.748499 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.755140 (+ 6641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:57521: BlockingRecv error: recv got EOF from 127.20.34.65:57521 (error 108)
Metrics: {"server-negotiator.queue_time_us":2128,"thread_start_us":1904,"threads_started":1}
W20260805 22:54:44.931833 1668 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.123s user 0.005s sys 0.023s
W20260805 22:54:44.933347 1268 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:43.797537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:55233 (local address 127.20.34.126:43635)
0805 22:54:43.798134 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:43.798143 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:43.798181 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:54:43.801094 (+ 2913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:43.801105 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:43.801246 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:43.801425 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:43.803518 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.804274 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.806140 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.807195 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.807381 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.933036 (+1125655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:55233: BlockingRecv error: recv got EOF from 127.20.34.67:55233 (error 108)
Metrics: {"server-negotiator.queue_time_us":351,"spinlock_wait_cycles":1792}
I20260805 22:54:44.934092 1668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:43.796515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:55233)
0805 22:54:43.797638 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:43.797692 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:43.800594 (+ 2902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:43.801800 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:43.801815 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:43.802613 (+ 798us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:43.803331 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:43.803350 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.804452 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.804456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:43.805945 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:43.805962 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:43.807506 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:43.807517 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:43.807861 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:43.808856 (+ 995us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:43.808901 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:44.932856 (+1123955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":1481,"threads_started":1}
W20260805 22:54:44.935060 1665 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:43635 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.34.126:43635: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:44.945571 1668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:44.935757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:45359)
0805 22:54:44.935979 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:44.936003 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:44.936176 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:44.936538 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:44.936542 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:44.936965 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:44.937128 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.937137 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.938259 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.938265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.939268 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.939279 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.940062 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.940069 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.940310 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.940961 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:44.940981 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:44.945250 (+ 4269us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":66}
W20260805 22:54:44.945793 1268 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:44.935836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:45359 (local address 127.20.34.126:43635)
0805 22:54:44.936114 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:44.936120 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:44.936138 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:54:44.936325 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:44.936330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:44.936399 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:44.936511 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:44.937284 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.938101 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.939414 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.939883 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.940045 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.945537 (+ 5492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:45359: BlockingRecv error: recv got EOF from 127.20.34.67:45359 (error 108)
Metrics: {"server-negotiator.queue_time_us":144}
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:44 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:44.955792 1668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:44.946463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:53131)
0805 22:54:44.946674 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:44.946696 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:44.946812 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:44.947234 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:44.947239 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:44.947701 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:44.947874 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.947884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.949027 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.949032 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.950096 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:44.950112 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.950939 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.950943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:44.951073 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.951744 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:44.951763 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:44.955566 (+ 3803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":86}
W20260805 22:54:44.956243 1665 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:54:44.956279 1268 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:44.946597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:53131 (local address 127.20.34.126:43635)
0805 22:54:44.946797 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:44.946803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:44.946822 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:54:44.946972 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:44.946980 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:44.947067 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:44.947170 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:44.948042 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.948894 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.950247 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:44.950782 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:44.950885 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:44.955800 (+ 4915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:53131: BlockingRecv error: recv got EOF from 127.20.34.67:53131 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 05 22:54:45 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:45 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:45.101846 1680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:45.091722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:56417)
0805 22:54:45.092330 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:45.092348 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:45.092474 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:45.092857 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:45.092861 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:45.093340 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:45.093500 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:45.093509 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.094602 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.094607 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:45.095594 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:45.095607 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.096449 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.096454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:45.096603 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:45.097312 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:45.097337 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:45.101592 (+ 4255us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":351,"threads_started":1}
W20260805 22:54:45.102125 1268 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:45.091825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:56417 (local address 127.20.34.126:43635)
0805 22:54:45.092115 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:45.092123 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:45.092441 (+ 318us) server_negotiation.cc:407] Connection header received
0805 22:54:45.092590 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:45.092594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:45.092678 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:45.092788 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:45.093662 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.094459 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.095742 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.096258 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.096360 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:45.101816 (+ 5456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:56417: BlockingRecv error: recv got EOF from 127.20.34.66:56417 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 05 22:54:45 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:45 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:45.766249 1681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:45.755975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:49343)
0805 22:54:45.756628 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:45.756670 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:45.756811 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:45.757145 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:45.757148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:45.757637 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:45.757897 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:45.757907 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.759009 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.759013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:45.759948 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:45.759959 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.760675 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.760680 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:45.760935 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:45.761702 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:45.761727 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:45.765987 (+ 4260us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":413,"threads_started":1}
W20260805 22:54:45.766644 1683 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:45.756093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:49343 (local address 127.20.34.126:43635)
0805 22:54:45.756647 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:45.756652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:45.756762 (+ 110us) server_negotiation.cc:407] Connection header received
0805 22:54:45.756927 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:45.756931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:45.756996 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:45.757091 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:45.758036 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.758839 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.760093 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.760527 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.760628 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:45.766220 (+ 5592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:49343: BlockingRecv error: recv got EOF from 127.20.34.65:49343 (error 108)
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":310,"threads_started":1}
Aug 05 22:54:45 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:45 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:45.966408 1686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:45.956814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:34671)
0805 22:54:45.957410 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:45.957428 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:45.957568 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:45.957934 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:45.957939 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:45.958409 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:45.958601 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:45.958612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.959648 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.959652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:45.960649 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:45.960660 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.961360 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.961364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:45.961501 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:45.962209 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:45.962228 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:45.966074 (+ 3846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":329,"threads_started":1}
W20260805 22:54:45.966590 1683 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:45.956927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:34671 (local address 127.20.34.126:43635)
0805 22:54:45.957231 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:45.957237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:45.957534 (+ 297us) server_negotiation.cc:407] Connection header received
0805 22:54:45.957680 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:45.957684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:45.957782 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:45.957903 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:45.958769 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.959514 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.960783 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:45.961190 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:45.961296 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:45.966352 (+ 5056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:34671: BlockingRecv error: recv got EOF from 127.20.34.67:34671 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
Aug 05 22:54:46 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:46 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:46.113260 1688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:46.103089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:39129)
0805 22:54:46.103703 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:46.103726 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:46.103932 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:46.104603 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:46.104608 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:46.105215 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:46.105499 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:46.105515 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.106605 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.106610 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:46.107570 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:46.107583 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.108331 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.108335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:46.108471 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:46.109181 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:46.109201 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:46.112980 (+ 3779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":345,"threads_started":1}
W20260805 22:54:46.113508 1683 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:46.103253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:39129 (local address 127.20.34.126:43635)
0805 22:54:46.103481 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:46.103490 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:46.103896 (+ 406us) server_negotiation.cc:407] Connection header received
0805 22:54:46.104118 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:46.104125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:46.104268 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:46.104433 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:46.105671 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.106446 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.107705 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.108107 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.108286 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:46.113209 (+ 4923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:39129: BlockingRecv error: recv got EOF from 127.20.34.66:39129 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 05 22:54:46 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:46 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:46.782461 1690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:46.767483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:38803)
0805 22:54:46.768109 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:46.768127 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:46.768342 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:46.768703 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:46.768707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:46.769121 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:46.769298 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:46.769307 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.770712 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.770719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:46.771992 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:46.772007 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.772743 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.772748 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:46.772873 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:46.777673 (+ 4800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:46.777697 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:46.782100 (+ 4403us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":346,"threads_started":1}
W20260805 22:54:46.782794 1691 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:46.767712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:38803 (local address 127.20.34.126:43635)
0805 22:54:46.768309 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:46.768314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:46.768332 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:54:46.768470 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:46.768474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:46.768550 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:46.768651 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:46.769476 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.770503 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.772187 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.772608 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.772714 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:46.782459 (+ 9745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:38803: BlockingRecv error: recv got EOF from 127.20.34.65:38803 (error 108)
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":315,"threads_started":1}
Aug 05 22:54:46 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:46 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:46.978698 1692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:46.967671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:56847)
0805 22:54:46.968290 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:46.968313 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:46.968440 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:46.968776 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:46.968780 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:46.969208 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:46.969485 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:46.969494 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.970783 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.970788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:46.972330 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:46.972349 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.973235 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.973240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:46.973398 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:46.974153 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:46.974171 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:46.978275 (+ 4104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":352,"threads_started":1}
W20260805 22:54:46.978789 1691 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:46.967728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:56847 (local address 127.20.34.126:43635)
0805 22:54:46.967931 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:46.967935 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:46.968405 (+ 470us) server_negotiation.cc:407] Connection header received
0805 22:54:46.968543 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:46.968548 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:46.968614 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:46.968700 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:46.969617 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.970592 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.972489 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:46.973044 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:46.973146 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:46.978534 (+ 5388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:56847: BlockingRecv error: recv got EOF from 127.20.34.67:56847 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 05 22:54:47 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:47 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:47.124130 1693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:47.114354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:38143)
0805 22:54:47.115060 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:47.115082 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:47.115238 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:47.115613 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:47.115616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:47.115980 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:47.116234 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:47.116251 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.117314 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.117318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:47.118253 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:47.118265 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.119067 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.119072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:47.119194 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:47.119788 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:47.119805 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:47.123767 (+ 3962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":313,"threads_started":1}
W20260805 22:54:47.124529 1691 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:47.114431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:38143 (local address 127.20.34.126:43635)
0805 22:54:47.114748 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:47.114755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:47.115192 (+ 437us) server_negotiation.cc:407] Connection header received
0805 22:54:47.115374 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:47.115378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:47.115460 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:47.115547 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:47.116390 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.117190 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.118417 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.118916 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.119035 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:47.124041 (+ 5006us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:38143: BlockingRecv error: recv got EOF from 127.20.34.66:38143 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
Aug 05 22:54:47 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:47 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:47.795111 1694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:47.784671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:40121)
0805 22:54:47.785341 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:47.785369 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:47.785541 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:47.786054 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:47.786060 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:47.786533 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:47.786723 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:47.786733 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.787878 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.787888 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:47.789211 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:47.789226 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.790123 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.790130 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:47.790359 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:47.791161 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:47.791188 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:47.794863 (+ 3675us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":339,"threads_started":1}
W20260805 22:54:47.795388 1695 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:47.784740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:40121 (local address 127.20.34.126:43635)
0805 22:54:47.785703 (+ 963us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:47.785711 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:47.785736 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:54:47.785791 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:47.785795 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:47.785860 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:47.786004 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:47.786909 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.787719 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.789373 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.789877 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.790057 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:47.795091 (+ 5034us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:40121: BlockingRecv error: recv got EOF from 127.20.34.65:40121 (error 108)
Metrics: {"server-negotiator.queue_time_us":817,"thread_start_us":633,"threads_started":1}
Aug 05 22:54:47 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:47 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:47.989038 1697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:47.979802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:41199)
0805 22:54:47.980401 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:47.980418 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:47.980539 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:47.980855 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:47.980858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:47.981236 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:47.981426 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:47.981435 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.982482 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.982486 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:47.983409 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:47.983420 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.984058 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.984063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:47.984206 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:47.984918 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:47.984935 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:47.988703 (+ 3768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":304,"threads_started":1}
W20260805 22:54:47.989207 1695 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:47.979923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:41199 (local address 127.20.34.126:43635)
0805 22:54:47.980296 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:47.980304 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:47.980502 (+ 198us) server_negotiation.cc:407] Connection header received
0805 22:54:47.980645 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:47.980649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:47.980715 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:47.980797 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:47.981569 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.982346 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.983531 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:47.983925 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:47.984017 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:47.988975 (+ 4958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:41199: BlockingRecv error: recv got EOF from 127.20.34.67:41199 (error 108)
Metrics: {"server-negotiator.queue_time_us":179}
Aug 05 22:54:48 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:48 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:48.135946 1698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:48.125399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:40179)
0805 22:54:48.126043 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:48.126062 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:48.126203 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:48.126650 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:48.126654 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:48.127156 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:48.127355 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:48.127365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.128887 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.128892 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:48.130279 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:48.130297 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.131121 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.131126 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:48.131268 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:48.131953 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:48.131972 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:48.135669 (+ 3697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":398,"threads_started":1}
W20260805 22:54:48.136530 1695 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:48.125512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:40179 (local address 127.20.34.126:43635)
0805 22:54:48.125836 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:48.125845 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:48.126168 (+ 323us) server_negotiation.cc:407] Connection header received
0805 22:54:48.126380 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:48.126385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:48.126477 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:48.126577 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:48.127558 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.128723 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.130466 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.130963 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.131069 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:48.136124 (+ 5055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:40179: BlockingRecv error: recv got EOF from 127.20.34.66:40179 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
Aug 05 22:54:48 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:48 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:48.806273 1699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:48.796292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:56869)
0805 22:54:48.796898 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:48.796917 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:48.797038 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:48.797497 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:48.797502 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:48.797955 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:48.798120 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:48.798129 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.799318 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.799322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:48.800786 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:48.800813 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.801564 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.801568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:48.801699 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:48.802423 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:48.802442 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:48.806040 (+ 3598us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":319,"threads_started":1}
W20260805 22:54:48.806536 1700 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:48.796400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:56869 (local address 127.20.34.126:43635)
0805 22:54:48.797003 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:48.797007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:48.797028 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:54:48.797164 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:48.797168 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:48.797245 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:48.797352 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:48.798283 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.799132 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.800960 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.801422 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.801523 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:48.806285 (+ 4762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:56869: BlockingRecv error: recv got EOF from 127.20.34.65:56869 (error 108)
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":349,"threads_started":1}
Aug 05 22:54:48 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:48 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:49.000501 1703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:48.990510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:32857)
0805 22:54:48.991196 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:48.991218 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:48.991400 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:48.991808 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:48.991813 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:48.992305 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:48.992499 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:48.992509 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.993579 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.993586 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:48.994610 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:48.994623 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.995399 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.995405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:48.995610 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:48.996336 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:48.996355 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:49.000140 (+ 3785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":404,"threads_started":1}
W20260805 22:54:49.000720 1700 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:48.990618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:32857 (local address 127.20.34.126:43635)
0805 22:54:48.990848 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:48.990856 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:48.991326 (+ 470us) server_negotiation.cc:407] Connection header received
0805 22:54:48.991549 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:48.991555 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:48.991631 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:48.991753 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:48.992668 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.993422 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.994775 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:48.995217 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:48.995369 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:49.000458 (+ 5089us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:32857: BlockingRecv error: recv got EOF from 127.20.34.67:32857 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 05 22:54:49 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:49 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:49.147070 1704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:49.137136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:55149)
0805 22:54:49.137727 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:49.137745 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:49.137878 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:49.138219 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:49.138222 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:49.138677 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:49.138845 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:49.138853 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:49.139906 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:49.139910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:49.141184 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:49.141202 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:49.142066 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:49.142071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:49.142203 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:49.142991 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:49.143010 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:49.146810 (+ 3800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":336,"threads_started":1}
W20260805 22:54:49.147393 1700 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:49.137377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:55149 (local address 127.20.34.126:43635)
0805 22:54:49.137622 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:49.137630 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:49.137834 (+ 204us) server_negotiation.cc:407] Connection header received
0805 22:54:49.137995 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:49.137999 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:49.138080 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:49.138170 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:49.138979 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:49.139763 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:49.141400 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:49.141898 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:49.142034 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:49.147054 (+ 5020us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:55149: BlockingRecv error: recv got EOF from 127.20.34.66:55149 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 05 22:54:49 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:49 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:49.817287 1705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:49.807406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:59543)
0805 22:54:49.807996 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:49.808014 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:49.808138 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:49.808550 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:49.808554 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:49.809010 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:49.809197 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:49.809205 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:49.810276 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:49.810280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:49.811227 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:49.811240 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:49.811937 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:49.811942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:49.812085 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:49.812757 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:49.812776 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:49.817045 (+ 4269us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":331,"threads_started":1}
W20260805 22:54:49.817629 1708 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:49.807505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:59543 (local address 127.20.34.126:43635)
0805 22:54:49.808089 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:49.808093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:49.808113 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:54:49.808327 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:49.808331 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:49.808400 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:49.808498 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:49.809347 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:49.810128 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:49.811373 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:49.811770 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:49.811868 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:49.817309 (+ 5441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:59543: BlockingRecv error: recv got EOF from 127.20.34.65:59543 (error 108)
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":330,"threads_started":1}
Aug 05 22:54:50 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:50 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:50.011373 1709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:50.002144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:48515)
0805 22:54:50.002705 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:50.002723 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:50.002852 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:50.003189 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:50.003192 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:50.003655 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:50.003810 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:50.003818 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.004869 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.004873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:50.005825 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:50.005837 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.006630 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.006635 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:50.006816 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:50.007489 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:50.007506 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:50.011130 (+ 3624us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":317,"threads_started":1}
W20260805 22:54:50.011667 1708 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:50.002267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:48515 (local address 127.20.34.126:43635)
0805 22:54:50.002546 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:50.002553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:50.002823 (+ 270us) server_negotiation.cc:407] Connection header received
0805 22:54:50.002974 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:50.002979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:50.003047 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:50.003135 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:50.003943 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.004738 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.006013 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.006466 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.006617 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:50.011408 (+ 4791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:48515: BlockingRecv error: recv got EOF from 127.20.34.67:48515 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 05 22:54:50 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:50 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:50.157845 1712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:50.148129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:39205)
0805 22:54:50.148704 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:50.148722 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:50.148868 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:50.149226 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:50.149229 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:50.149664 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:50.149953 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:50.149966 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.151043 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.151047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:50.152068 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:50.152081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.152748 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.152753 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:50.152901 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:50.153581 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:50.153599 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:50.157465 (+ 3866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":288,"threads_started":1}
W20260805 22:54:50.158027 1708 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:50.148264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:39205 (local address 127.20.34.126:43635)
0805 22:54:50.148442 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:50.148447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:50.148832 (+ 385us) server_negotiation.cc:407] Connection header received
0805 22:54:50.148997 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:50.149001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:50.149078 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:50.149172 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:50.150105 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.150912 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.152210 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.152603 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.152694 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:50.157704 (+ 5010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:39205: BlockingRecv error: recv got EOF from 127.20.34.66:39205 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 05 22:54:50 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:50 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:50.834091 1713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:50.818230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:35133)
0805 22:54:50.824671 (+ 6441us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:50.824699 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:50.824893 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:50.825303 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:50.825309 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:50.825774 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:50.825950 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:50.825959 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.827030 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.827036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:50.828011 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:50.828023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.828828 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.828835 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:50.829008 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:50.829670 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:50.829688 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:50.833724 (+ 4036us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":6301,"thread_start_us":6037,"threads_started":1}
W20260805 22:54:50.834368 1716 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:50.821144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:35133 (local address 127.20.34.126:43635)
0805 22:54:50.822092 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:50.822101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:50.824816 (+ 2715us) server_negotiation.cc:407] Connection header received
0805 22:54:50.825047 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:50.825053 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:50.825139 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:50.825259 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:50.826106 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.826877 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.828194 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:50.828651 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:50.828813 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:50.834023 (+ 5210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:35133: BlockingRecv error: recv got EOF from 127.20.34.65:35133 (error 108)
Metrics: {"server-negotiator.queue_time_us":794,"thread_start_us":677,"threads_started":1}
Aug 05 22:54:51 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:51 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:51.022683 1717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:51.012841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:42657)
0805 22:54:51.013363 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:51.013380 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:51.013499 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:51.013829 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:51.013833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:51.014287 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:51.014469 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:51.014478 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.015530 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.015534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:51.016580 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:51.016594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.017396 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.017402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:51.017561 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:51.018517 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:51.018537 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:51.022423 (+ 3886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":280,"threads_started":1}
W20260805 22:54:51.022912 1716 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:51.012941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:42657 (local address 127.20.34.126:43635)
0805 22:54:51.013132 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:51.013137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:51.013494 (+ 357us) server_negotiation.cc:407] Connection header received
0805 22:54:51.013605 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:51.013609 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:51.013685 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:51.013772 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:51.014601 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.015403 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.016738 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.017181 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.017290 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:51.022684 (+ 5394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:42657: BlockingRecv error: recv got EOF from 127.20.34.67:42657 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 05 22:54:51 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:51 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:51.169667 1719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:51.159241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:42517)
0805 22:54:51.160015 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:51.160035 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:51.160222 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:51.160607 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:51.160611 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:51.161075 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:51.161291 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:51.161302 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.162664 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.162670 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:51.164133 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:51.164175 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.165003 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.165008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:51.165135 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:51.165727 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:51.165746 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:51.169413 (+ 3667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":395,"threads_started":1}
W20260805 22:54:51.169962 1716 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:51.159416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:42517 (local address 127.20.34.126:43635)
0805 22:54:51.159669 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:51.159674 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:51.160132 (+ 458us) server_negotiation.cc:407] Connection header received
0805 22:54:51.160373 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:51.160377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:51.160447 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:51.160543 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:51.161437 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.162476 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.164304 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.164845 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.164946 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:51.169633 (+ 4687us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:42517: BlockingRecv error: recv got EOF from 127.20.34.66:42517 (error 108)
Metrics: {"server-negotiator.queue_time_us":117}
Aug 05 22:54:51 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:51 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:51.851368 1721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:51.835410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:41203)
0805 22:54:51.836553 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:51.836575 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:51.836776 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:51.837177 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:51.837183 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:51.837663 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:51.837841 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:51.837850 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.838998 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.839003 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:51.840099 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:51.840114 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.840974 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.840983 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:51.841157 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:51.846514 (+ 5357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:51.846538 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:51.851069 (+ 4531us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":840,"thread_start_us":717,"threads_started":1}
W20260805 22:54:51.851761 1722 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:51.835704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:41203 (local address 127.20.34.126:43635)
0805 22:54:51.836574 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:51.836582 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:51.836691 (+ 109us) server_negotiation.cc:407] Connection header received
0805 22:54:51.836924 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:51.836930 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:51.837016 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:51.837142 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:51.838030 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.838839 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.840291 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:51.840762 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:51.840908 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:51.851351 (+ 10443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:41203: BlockingRecv error: recv got EOF from 127.20.34.65:41203 (error 108)
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":599,"threads_started":1}
Aug 05 22:54:52 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:52 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:52.034423 1723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:52.023730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:54375)
0805 22:54:52.024444 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:52.024461 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:52.024586 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:52.024948 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:52.024951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:52.025387 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:52.025565 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:52.025573 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.026716 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.026721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:52.027755 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:52.027770 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.028712 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.028719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:52.028920 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:52.029702 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:52.029729 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:52.034023 (+ 4294us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":378,"threads_started":1}
W20260805 22:54:52.034543 1722 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:52.024020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:54375 (local address 127.20.34.126:43635)
0805 22:54:52.024292 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:52.024297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:52.024546 (+ 249us) server_negotiation.cc:407] Connection header received
0805 22:54:52.024693 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:52.024697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:52.024766 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:52.024882 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:52.025696 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.026473 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.027935 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.028548 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.028682 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:52.034254 (+ 5572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:54375: BlockingRecv error: recv got EOF from 127.20.34.67:54375 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 05 22:54:52 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:52 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:52.180948 1724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:52.170724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:41921)
0805 22:54:52.171274 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:52.171301 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:52.171425 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:52.171782 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:52.171788 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:52.172310 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:52.172487 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:52.172497 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.173764 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.173772 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:52.174937 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:52.174951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.175727 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.175733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:52.175934 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:52.176629 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:52.176648 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:52.180572 (+ 3924us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":295,"threads_started":1}
W20260805 22:54:52.181150 1722 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:52.170896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:41921 (local address 127.20.34.126:43635)
0805 22:54:52.171111 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:52.171118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:52.171387 (+ 269us) server_negotiation.cc:407] Connection header received
0805 22:54:52.171518 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:52.171522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:52.171620 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:52.171746 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:52.172646 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.173608 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.175104 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.175527 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.175671 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:52.180839 (+ 5168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:41921: BlockingRecv error: recv got EOF from 127.20.34.66:41921 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 05 22:54:52 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:52 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:52.863469 1726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:52.852552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:37987)
0805 22:54:52.853500 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:52.853518 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:52.853718 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:52.854224 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:52.854230 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:52.854830 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:52.855070 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:52.855083 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.856389 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.856394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:52.857473 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:52.857488 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.858224 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.858231 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:52.858376 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:52.859047 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:52.859068 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:52.863211 (+ 4143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":811,"thread_start_us":630,"threads_started":1}
W20260805 22:54:52.863976 1727 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:52.852629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:37987 (local address 127.20.34.126:43635)
0805 22:54:52.853187 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:52.853193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:52.853659 (+ 466us) server_negotiation.cc:407] Connection header received
0805 22:54:52.853909 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:52.853915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:52.854001 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:52.854147 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:52.855231 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.856236 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.857609 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:52.858051 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:52.858147 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:52.863670 (+ 5523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:37987: BlockingRecv error: recv got EOF from 127.20.34.65:37987 (error 108)
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":274,"threads_started":1}
Aug 05 22:54:53 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:53 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:53.046203 1728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:53.035724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:36139)
0805 22:54:53.036409 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:53.036431 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:53.036575 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:53.037057 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:53.037061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:53.037525 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:53.037701 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:53.037709 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.038871 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.038876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:53.039863 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:53.039876 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.040702 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.040708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:53.040840 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:53.041557 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:53.041576 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:53.045924 (+ 4348us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":334,"threads_started":1}
W20260805 22:54:53.046348 1727 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:53.035795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:36139 (local address 127.20.34.126:43635)
0805 22:54:53.036110 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:53.036118 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:53.036534 (+ 416us) server_negotiation.cc:407] Connection header received
0805 22:54:53.036785 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:53.036790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:53.036861 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:53.036957 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:53.037870 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.038698 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.040077 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.040520 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.040629 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:53.046135 (+ 5506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:36139: BlockingRecv error: recv got EOF from 127.20.34.67:36139 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 05 22:54:53 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:53 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:53.194597 1731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:53.182649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:39425)
0805 22:54:53.183537 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:53.183558 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:53.183755 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:53.184311 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:53.184327 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:53.185002 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:53.185254 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:53.185270 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.186909 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.186916 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:53.188423 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:53.188439 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.189522 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.189527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:53.189669 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:53.190262 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:53.190280 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:53.194203 (+ 3923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":761,"thread_start_us":601,"threads_started":1}
W20260805 22:54:53.194751 1727 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:53.182782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:39425 (local address 127.20.34.126:43635)
0805 22:54:53.183078 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:53.183087 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:53.183707 (+ 620us) server_negotiation.cc:407] Connection header received
0805 22:54:53.183966 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:53.183974 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:53.184086 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:53.184216 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:53.185473 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.186654 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.188607 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.189307 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.189470 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:53.194456 (+ 4986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:39425: BlockingRecv error: recv got EOF from 127.20.34.66:39425 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 05 22:54:53 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:53 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:53.875536 1732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:53.864738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:49347)
0805 22:54:53.865432 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:53.865450 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:53.865565 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:53.865930 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:53.865933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:53.866299 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:53.866451 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:53.866458 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.867604 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.867608 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:53.868701 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:53.868715 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.869567 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.869572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:53.869699 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:53.870559 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:53.870578 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:53.875158 (+ 4580us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":398,"threads_started":1}
W20260805 22:54:53.875715 1733 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:53.864853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:49347 (local address 127.20.34.126:43635)
0805 22:54:53.865520 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:53.865526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:53.865544 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:54:53.865696 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:53.865701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:53.865778 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:53.865878 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:53.866635 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.867445 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.868852 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:53.869371 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:53.869497 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:53.875440 (+ 5943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:49347: BlockingRecv error: recv got EOF from 127.20.34.65:49347 (error 108)
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":394,"threads_started":1}
Aug 05 22:54:54 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:54 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:54.058522 1734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:54.047610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:44475)
0805 22:54:54.048246 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:54.048264 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:54.048400 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:54.048705 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:54.048708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:54.049164 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:54.049401 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:54.049423 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.050868 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.050873 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:54.052364 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:54.052380 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.053089 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.053094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:54.053338 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:54.054014 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:54.054035 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:54.058203 (+ 4168us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":315,"threads_started":1}
W20260805 22:54:54.058702 1733 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:54.047669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:44475 (local address 127.20.34.126:43635)
0805 22:54:54.047862 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:54.047867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:54.048354 (+ 487us) server_negotiation.cc:407] Connection header received
0805 22:54:54.048509 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:54.048514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:54.048579 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:54.048671 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:54.049586 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.050686 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.052519 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.052930 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.053027 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:54.058464 (+ 5437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:44475: BlockingRecv error: recv got EOF from 127.20.34.67:44475 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 05 22:54:54 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:54 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:54.205740 1735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:54.195862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:37677)
0805 22:54:54.196490 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:54.196507 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:54.196631 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:54.196974 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:54.196978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:54.197377 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:54.197549 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:54.197557 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.198727 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.198731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:54.199729 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:54.199740 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.200466 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.200471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:54.200613 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:54.201219 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:54.201238 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:54.205399 (+ 4161us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":361,"threads_started":1}
W20260805 22:54:54.206008 1733 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:54.195921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:37677 (local address 127.20.34.126:43635)
0805 22:54:54.196118 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:54.196123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:54.196596 (+ 473us) server_negotiation.cc:407] Connection header received
0805 22:54:54.196743 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:54.196747 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:54.196831 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:54.196919 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:54.197698 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.198589 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.199861 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.200284 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.200393 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:54.205646 (+ 5253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:37677: BlockingRecv error: recv got EOF from 127.20.34.66:37677 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 05 22:54:54 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:54 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:54.886258 1736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:54.876757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:39163)
0805 22:54:54.877307 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:54.877324 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:54.877439 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:54.877779 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:54.877782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:54.878218 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:54.878405 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:54.878414 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.879465 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.879469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:54.880470 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:54.880482 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.881557 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.881567 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:54.881702 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:54.882465 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:54.882513 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:54.886027 (+ 3514us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":304,"threads_started":1}
W20260805 22:54:54.886528 1738 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:54.876959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:39163 (local address 127.20.34.126:43635)
0805 22:54:54.877497 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:54.877502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:54.877518 (+ 16us) server_negotiation.cc:407] Connection header received
0805 22:54:54.877565 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:54.877569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:54.877634 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:54.877728 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:54.878564 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.879342 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.880632 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:54.881263 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:54.881392 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:54.886245 (+ 4853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:39163: BlockingRecv error: recv got EOF from 127.20.34.65:39163 (error 108)
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":321,"threads_started":1}
Aug 05 22:54:55 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:55 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:55.069597 1740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:55.059603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:33573)
0805 22:54:55.060373 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:55.060400 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:55.060566 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:55.060941 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:55.060945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:55.061339 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:55.061525 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:55.061533 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.062602 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.062606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:55.063622 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:55.063634 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.064551 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.064557 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:55.064695 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:55.065454 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:55.065474 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:55.069340 (+ 3866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":485,"threads_started":1}
W20260805 22:54:55.069850 1738 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:55.059660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:33573 (local address 127.20.34.126:43635)
0805 22:54:55.059863 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:55.059867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:55.060494 (+ 627us) server_negotiation.cc:407] Connection header received
0805 22:54:55.060710 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:55.060716 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:55.060795 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:55.060884 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:55.061670 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.062455 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.063790 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.064360 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.064469 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:55.069614 (+ 5145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:33573: BlockingRecv error: recv got EOF from 127.20.34.67:33573 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 05 22:54:55 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:55 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:55.217186 1741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:55.207023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:36613)
0805 22:54:55.207615 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:55.207631 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:55.207759 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:55.208111 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:55.208114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:55.208611 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:55.208814 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:55.208822 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.209887 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.209891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:55.211214 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:55.211228 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.212147 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.212181 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:55.212398 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:55.213077 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:55.213096 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:55.216839 (+ 3743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":356,"threads_started":1}
W20260805 22:54:55.217365 1738 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:55.207123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:36613 (local address 127.20.34.126:43635)
0805 22:54:55.207332 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:55.207337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:55.207745 (+ 408us) server_negotiation.cc:407] Connection header received
0805 22:54:55.207874 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:55.207878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:55.207946 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:55.208053 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:55.208952 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.209746 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.211366 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.211975 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.212121 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:55.217073 (+ 4952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:36613: BlockingRecv error: recv got EOF from 127.20.34.66:36613 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 05 22:54:55 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:55 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:55.898561 1744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:55.887362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:41503)
0805 22:54:55.888355 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:55.888381 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:55.888524 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:55.888912 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:55.888918 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:55.889437 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:55.889623 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:55.889633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.890722 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.890726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:55.891692 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:55.891704 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.892447 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.892452 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:55.892671 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:55.893427 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:55.893451 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:55.898095 (+ 4644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":620,"threads_started":1}
W20260805 22:54:55.898658 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:55.887401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:41503 (local address 127.20.34.126:43635)
0805 22:54:55.888586 (+ 1185us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:55.888591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:55.888608 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:54:55.888656 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:55.888659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:55.888729 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:55.888826 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:55.889815 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.890575 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.891864 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:55.892307 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:55.892404 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:55.898369 (+ 5965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:41503: BlockingRecv error: recv got EOF from 127.20.34.65:41503 (error 108)
Metrics: {"server-negotiator.queue_time_us":1092,"thread_start_us":981,"threads_started":1}
Aug 05 22:54:56 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:56 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:56.081782 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:56.070911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:33867)
0805 22:54:56.071530 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:56.071549 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:56.071683 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:56.072137 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:56.072141 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:56.072666 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:56.072914 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:56.072933 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.074011 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.074015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:56.075226 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:56.075240 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.075968 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.075973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:56.076115 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:56.076934 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:56.076956 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:56.081505 (+ 4549us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":327,"threads_started":1}
W20260805 22:54:56.081945 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:56.070949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:33867 (local address 127.20.34.126:43635)
0805 22:54:56.071176 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:56.071180 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:56.071641 (+ 461us) server_negotiation.cc:407] Connection header received
0805 22:54:56.071864 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:56.071868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:56.071939 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:56.072046 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:56.073063 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.073883 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.075386 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.075810 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.075919 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:56.081709 (+ 5790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:33867: BlockingRecv error: recv got EOF from 127.20.34.67:33867 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 05 22:54:56 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:56 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:56.228402 1747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:56.218530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:40493)
0805 22:54:56.219150 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:56.219167 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:56.219288 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:56.219656 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:56.219659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:56.220127 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:56.220349 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:56.220359 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.221386 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.221390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:56.222327 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:56.222339 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.223118 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.223123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:56.223263 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:56.223912 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:56.223931 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:56.228013 (+ 4082us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":331,"threads_started":1}
W20260805 22:54:56.228621 1743 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:56.218579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:40493 (local address 127.20.34.126:43635)
0805 22:54:56.218808 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:56.218816 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:56.219291 (+ 475us) server_negotiation.cc:407] Connection header received
0805 22:54:56.219418 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:56.219422 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:56.219512 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:56.219600 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:56.220479 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.221241 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.222484 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.222936 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.223033 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:56.228293 (+ 5260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:40493: BlockingRecv error: recv got EOF from 127.20.34.66:40493 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260805 22:54:57.708863 1748 sasl_common.cc:323] Time spent creating new SASL oryx client: real 0.804s user 0.001s sys 0.000s
W20260805 22:54:57.708840 1755 sasl_common.cc:323] Time spent creating new SASL oryx client: real 0.474s user 0.001s sys 0.000s
W20260805 22:54:57.708926 1751 sasl_common.cc:323] Time spent creating new SASL oryx client: real 0.620s user 0.001s sys 0.000s
Aug 05 22:54:57 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:57 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:57 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:57 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:57 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:57 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:57.714403 1751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:57.082937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:56643)
0805 22:54:57.083576 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:57.083595 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:57.083731 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:57.084113 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:57.084116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:57.084754 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:57.084958 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:57.084968 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:57.086437 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:57.086443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:57.087568 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:57.087584 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:57.088437 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:57.088442 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:57.088581 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:57.709038 (+620457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:57.709075 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:57.714018 (+ 4943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":337,"threads_started":1}
W20260805 22:54:57.714720 1754 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:57.083034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:56643 (local address 127.20.34.126:43635)
0805 22:54:57.083700 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:57.083705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:57.083726 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:54:57.083861 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:57.083865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:57.083933 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:57.084059 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:57.085141 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:57.086243 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:57.087722 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:57.088229 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:57.088329 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:57.714355 (+626026us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:56643: BlockingRecv error: recv got EOF from 127.20.34.67:56643 (error 108)
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":392,"threads_started":1}
W20260805 22:54:57.715129 1757 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:57.229796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:56773 (local address 127.20.34.126:43635)
0805 22:54:57.230440 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:57.230445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:57.230462 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:54:57.230510 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:57.230513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:57.230572 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:57.230661 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:57.231489 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:57.232414 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:57.233615 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:57.234050 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:57.234142 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:57.714653 (+480511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:56773: BlockingRecv error: recv got EOF from 127.20.34.66:56773 (error 108)
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":375,"threads_started":1}
W20260805 22:54:57.715196 1750 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:56.899986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:53165 (local address 127.20.34.126:43635)
0805 22:54:56.900567 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:56.900572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:56.900592 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:54:56.900667 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:56.900671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:56.900752 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:56.900853 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:56.901695 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.902511 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.904118 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.904762 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.904925 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:57.714819 (+809894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:53165: BlockingRecv error: recv got EOF from 127.20.34.65:53165 (error 108)
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":344,"threads_started":1}
I20260805 22:54:57.715171 1755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:57.229533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:56773)
0805 22:54:57.230047 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:57.230065 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:57.230180 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:57.230723 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:57.230727 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:57.231174 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:57.231337 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:57.231346 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:57.232558 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:57.232562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:57.233478 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:57.233491 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:57.234183 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:57.234187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:57.234309 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:57.709038 (+474729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:57.709075 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:57.714826 (+ 5751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":270,"threads_started":1}
I20260805 22:54:57.715725 1748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:56.899783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:53165)
0805 22:54:56.900436 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:56.900455 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:56.900568 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:56.900905 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:56.900909 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:56.901344 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:56.901502 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:56.901510 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.902694 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.902699 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:56.903935 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:56.903949 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:56.904949 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:56.904955 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:56.905164 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:57.709039 (+803875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:57.709079 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:57.715433 (+ 6354us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":378,"threads_started":1}
Aug 05 22:54:58 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:58 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:58 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.67@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:58 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.66@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 22:54:58 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 22:54:58.728600 1758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:58.716244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.67:33497)
0805 22:54:58.716907 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:58.716931 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:58.717059 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:58.717689 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:58.717695 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:58.718419 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:58.718646 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:58.718664 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.720345 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.720350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:58.721928 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:58.721942 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.722651 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.722657 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:58.722847 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.723544 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:58.723567 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:58.728207 (+ 4640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":339,"threads_started":1}
W20260805 22:54:58.728726 1759 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:58.716407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:33497 (local address 127.20.34.126:43635)
0805 22:54:58.717164 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:58.717171 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:58.717190 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:54:58.717252 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:58.717260 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:58.717338 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:58.717453 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:58.718829 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.720117 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.722084 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.722492 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.722632 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.728449 (+ 5817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.67:33497: BlockingRecv error: recv got EOF from 127.20.34.67:33497 (error 108)
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":736,"threads_started":1}
Aug 05 22:54:58 dist-test-slave-gmjp krb5kdc[32674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.34.65@KRBTEST.COM for oryx/127.20.34.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 22:54:58.729627 1763 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:58.717338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:43861 (local address 127.20.34.126:43635)
0805 22:54:58.718678 (+ 1340us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:58.718683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:58.718696 (+ 13us) server_negotiation.cc:407] Connection header received
0805 22:54:58.718734 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:58.718737 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:58.718828 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:58.718947 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:58.720141 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.721118 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.722732 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.723329 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.723453 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.729366 (+ 5913us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.66:43861: BlockingRecv error: recv got EOF from 127.20.34.66:43861 (error 108)
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":1206,"thread_start_us":966,"threads_started":1}
I20260805 22:54:58.730224 1761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:58.717027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.66:43861)
0805 22:54:58.717613 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:58.717641 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:58.717786 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:58.719226 (+ 1440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:58.719231 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:58.719755 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:58.719971 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:58.719984 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.721276 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.721282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:58.722535 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:58.722554 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.723698 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.723706 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:58.723916 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.724652 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:58.724677 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:58.729850 (+ 5173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":512,"threads_started":1}
I20260805 22:54:58.730862 1760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:58.717019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43635 (local address 127.20.34.65:60127)
0805 22:54:58.718303 (+ 1284us) negotiation.cc:107] Waiting for socket to connect
0805 22:54:58.718323 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:54:58.718481 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:54:58.719567 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:54:58.719574 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:54:58.720007 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:54:58.720299 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:58.720316 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.721922 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.721928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:58.723753 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:54:58.723770 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.725327 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.725334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:54:58.725548 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.726208 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:54:58.726241 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:54:58.730632 (+ 4391us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.34.126:43635: Server oryx/127.20.34.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1139,"thread_start_us":1046,"threads_started":1}
W20260805 22:54:58.731163 1766 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:54:58.718563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:60127 (local address 127.20.34.126:43635)
0805 22:54:58.719294 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:58.719298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:58.719314 (+ 16us) server_negotiation.cc:407] Connection header received
0805 22:54:58.719351 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:58.719354 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:58.719399 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:58.719520 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:58.720531 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.721737 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.723958 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.725073 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.725306 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.730849 (+ 5543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.34.65:60127: BlockingRecv error: recv got EOF from 127.20.34.65:60127 (error 108)
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":641,"thread_start_us":476,"threads_started":1}
I20260805 22:54:58.798211 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 1045
I20260805 22:54:58.812299 1768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:58.799749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44624 (local address 127.20.34.65:34481)
0805 22:54:58.800489 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:58.800497 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:58.800529 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:54:58.800595 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:58.800602 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:58.800861 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:58.801034 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:58.802709 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.803935 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.805238 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.805883 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.806004 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.808860 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:58.808870 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:58.808886 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:58.808932 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:58.811601 (+ 2669us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.34.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0805 22:54:58.811939 (+ 338us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44624: Request ticket server kudu/127.20.34.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":384,"threads_started":1}
W20260805 22:54:58.812431 1768 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44624: Request ticket server kudu/127.20.34.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260805 22:54:58.812498 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 1045: Not authorized: Client connection negotiation failed: client connection to 127.20.34.65:34481: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.34.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260805 22:54:58.812765 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 1045
I20260805 22:54:58.843453 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 1271
I20260805 22:54:58.857952 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:58.844944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36862 (local address 127.20.34.66:35409)
0805 22:54:58.845717 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:58.845726 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:58.845809 (+ 83us) server_negotiation.cc:407] Connection header received
0805 22:54:58.845908 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:58.845916 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:58.846171 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:58.846416 (+ 245us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:58.847948 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.849163 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.850512 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.851142 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.851316 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.854119 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:58.854130 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:58.854146 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:58.854190 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:58.857163 (+ 2973us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.34.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0805 22:54:58.857587 (+ 424us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36862: Request ticket server kudu/127.20.34.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":424,"threads_started":1}
W20260805 22:54:58.858014 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 1271: Not authorized: Client connection negotiation failed: client connection to 127.20.34.66:35409: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.34.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260805 22:54:58.858103 1769 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36862: Request ticket server kudu/127.20.34.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260805 22:54:58.858219 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 1271
I20260805 22:54:58.889636 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 1463
I20260805 22:54:58.905853 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:58.891195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49178 (local address 127.20.34.67:39759)
0805 22:54:58.892009 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:58.892016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:58.892054 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:54:58.892135 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:58.892143 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:58.892497 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:58.892712 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:58.895172 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.896639 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.897990 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:58.898674 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:58.898821 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:58.901813 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:58.901825 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:58.901843 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:54:58.901917 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:58.905180 (+ 3263us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.34.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0805 22:54:58.905537 (+ 357us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49178: Request ticket server kudu/127.20.34.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":387,"threads_started":1}
W20260805 22:54:58.905998 1770 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49178: Request ticket server kudu/127.20.34.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260805 22:54:58.906113 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 1463: Not authorized: Client connection negotiation failed: client connection to 127.20.34.67:39759: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.20.34.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260805 22:54:58.906329 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 1463
I20260805 22:54:58.932502 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 942
I20260805 22:54:58.934000 1034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:54:59.061499 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 942
2026-08-05T22:54:59Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22459 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-05T22:54:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:54:59Z Disabled control of system clock
I20260805 22:54:59.168064 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43781
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:38899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:43781
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260805 22:54:59.540599 1775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:54:59.540925 1775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:54:59.541010 1775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:54:59.548659 1775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:54:59.548804 1775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:54:59.548851 1775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:54:59.548902 1775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:54:59.548949 1775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:54:59.558804 1775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:43781
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:54:59.560338 1775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:54:59.562423 1775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:54:59.575191 1784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:59.575153 1785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:54:59.575273 1787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:54:59.575553 1775 server_base.cc:1034] running on GCE node
I20260805 22:54:59.576740 1775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:54:59.578279 1775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:54:59.579504 1775 hybrid_clock.cc:648] HybridClock initialized: now 1785970499579436 us; error 57 us; skew 500 ppm
I20260805 22:54:59.579908 1775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:54:59.582613 1775 webserver.cc:460] Webserver started at http://127.20.34.126:33409/ using document root <none> and password file <none>
I20260805 22:54:59.583396 1775 fs_manager.cc:359] Metadata directory not provided
I20260805 22:54:59.583490 1775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:54:59.583879 1775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:54:59.587126 1775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "b25e0ffc73a24378881aea8fafd29900"
format_stamp: "Formatted at 2026-08-05 22:54:59 on dist-test-slave-gmjp"
server_key: "414bd672aaf8b596bca4b6091a879bbf"
server_key_iv: "6668bb4869b4bf54a4d3f8f26cd61d47"
server_key_version: "encryptionkey@0"
I20260805 22:54:59.587984 1775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "b25e0ffc73a24378881aea8fafd29900"
format_stamp: "Formatted at 2026-08-05 22:54:59 on dist-test-slave-gmjp"
server_key: "414bd672aaf8b596bca4b6091a879bbf"
server_key_iv: "6668bb4869b4bf54a4d3f8f26cd61d47"
server_key_version: "encryptionkey@0"
I20260805 22:54:59.593560 1775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260805 22:54:59.597380 1795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:54:59.598898 1775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:54:59.599123 1775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "b25e0ffc73a24378881aea8fafd29900"
format_stamp: "Formatted at 2026-08-05 22:54:59 on dist-test-slave-gmjp"
server_key: "414bd672aaf8b596bca4b6091a879bbf"
server_key_iv: "6668bb4869b4bf54a4d3f8f26cd61d47"
server_key_version: "encryptionkey@0"
I20260805 22:54:59.599382 1775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:54:59.613778 1775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:54:59.614744 1775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:54:59.615084 1775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:54:59.634588 1775 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:43781
I20260805 22:54:59.634610 1870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:43781 every 8 connection(s)
I20260805 22:54:59.636137 1775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:54:59.640643 1871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:54:59.643752 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 1775
I20260805 22:54:59.643970 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:54:59.644970 20617 external_mini_cluster.cc:1428] Setting key 6b61fc5880d29fbc968e9c2330adb195
I20260805 22:54:59.654511 1871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900: Bootstrap starting.
I20260805 22:54:59.658179 1871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900: Neither blocks nor log segments found. Creating new log.
I20260805 22:54:59.659636 1871 log.cc:824] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900: Log is configured to *not* fsync() on all Append() calls
I20260805 22:54:59.659943 1877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:54:59.647711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54090 (local address 127.20.34.126:43781)
0805 22:54:59.648877 (+ 1166us) server_negotiation.cc:206] Beginning negotiation
0805 22:54:59.648889 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:54:59.648933 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:54:59.650667 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:54:59.650692 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:54:59.651183 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:54:59.651622 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:54:59.652303 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:59.653607 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:59.655065 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:54:59.655752 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:54:59.655965 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:54:59.657287 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:54:59.657295 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:54:59.657313 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:54:59.657890 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:54:59.657985 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:54:59.658007 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:54:59.658159 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0805 22:54:59.658412 (+ 253us) server_negotiation.cc:299] Negotiation successful
0805 22:54:59.658769 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":463,"threads_started":1}
I20260805 22:54:59.663139 1871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900: No bootstrap required, opened a new log
I20260805 22:54:59.671803 1871 raft_consensus.cc:348] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25e0ffc73a24378881aea8fafd29900" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43781 } }
I20260805 22:54:59.672375 1871 raft_consensus.cc:374] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:54:59.672498 1871 raft_consensus.cc:729] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25e0ffc73a24378881aea8fafd29900, State: Initialized, Role: FOLLOWER
I20260805 22:54:59.673142 1871 consensus_queue.cc:260] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25e0ffc73a24378881aea8fafd29900" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43781 } }
I20260805 22:54:59.673422 1871 raft_consensus.cc:388] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:54:59.673602 1871 raft_consensus.cc:482] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:54:59.673806 1871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:54:59.676319 1871 raft_consensus.cc:504] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25e0ffc73a24378881aea8fafd29900" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43781 } }
I20260805 22:54:59.676900 1871 leader_election.cc:302] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b25e0ffc73a24378881aea8fafd29900; no voters:
I20260805 22:54:59.677659 1871 leader_election.cc:288] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:54:59.677860 1879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:54:59.679029 1879 raft_consensus.cc:686] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [term 1 LEADER]: Becoming Leader. State: Replica: b25e0ffc73a24378881aea8fafd29900, State: Running, Role: LEADER
I20260805 22:54:59.679584 1879 consensus_queue.cc:237] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25e0ffc73a24378881aea8fafd29900" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43781 } }
I20260805 22:54:59.680325 1871 sys_catalog.cc:564] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:54:59.682885 1881 sys_catalog.cc:455] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b25e0ffc73a24378881aea8fafd29900. Latest consensus state: current_term: 1 leader_uuid: "b25e0ffc73a24378881aea8fafd29900" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25e0ffc73a24378881aea8fafd29900" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43781 } } }
I20260805 22:54:59.683238 1881 sys_catalog.cc:458] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:59.682605 1880 sys_catalog.cc:455] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b25e0ffc73a24378881aea8fafd29900" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b25e0ffc73a24378881aea8fafd29900" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43781 } } }
I20260805 22:54:59.683394 1880 sys_catalog.cc:458] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900 [sys.catalog]: This master's current role is: LEADER
I20260805 22:54:59.684108 1890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:54:59.689455 1890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:54:59.703291 1890 catalog_manager.cc:1347] Generated new cluster ID: 6a3c2ed5b7cd4467850c18d93d00bb8a
I20260805 22:54:59.703451 1890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:54:59.713531 1890 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:54:59.715051 1890 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:54:59.726441 1890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b25e0ffc73a24378881aea8fafd29900: Generated new TSK 0
I20260805 22:54:59.727541 1890 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:54:59.745486 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43781
--builtin_ntp_servers=127.20.34.84:38899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260805 22:55:00.118917 1909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:00.119233 1909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:00.119410 1909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:00.127103 1909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:00.127218 1909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:00.127394 1909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:55:00.136988 1909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:00.138538 1909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:00.140527 1909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:00.154836 1919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:00.154937 1917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:00.154923 1916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:00.160790 1909 server_base.cc:1034] running on GCE node
I20260805 22:55:00.161665 1909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:00.162703 1909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:00.163923 1909 hybrid_clock.cc:648] HybridClock initialized: now 1785970500163869 us; error 40 us; skew 500 ppm
I20260805 22:55:00.164355 1909 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:55:00.166968 1909 webserver.cc:460] Webserver started at http://127.20.34.65:46563/ using document root <none> and password file <none>
I20260805 22:55:00.167853 1909 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:00.167960 1909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:00.168429 1909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:00.171543 1909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "20ee8566061140d5957bc99b3b2d9ab2"
format_stamp: "Formatted at 2026-08-05 22:55:00 on dist-test-slave-gmjp"
server_key: "5033f1d0522f586f0924627b02b9c9e9"
server_key_iv: "2228ab8bf8cbe6c29a208244f1aac8ad"
server_key_version: "encryptionkey@0"
I20260805 22:55:00.172470 1909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "20ee8566061140d5957bc99b3b2d9ab2"
format_stamp: "Formatted at 2026-08-05 22:55:00 on dist-test-slave-gmjp"
server_key: "5033f1d0522f586f0924627b02b9c9e9"
server_key_iv: "2228ab8bf8cbe6c29a208244f1aac8ad"
server_key_version: "encryptionkey@0"
I20260805 22:55:00.178036 1909 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:55:00.182296 1928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:00.184221 1909 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:55:00.184432 1909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "20ee8566061140d5957bc99b3b2d9ab2"
format_stamp: "Formatted at 2026-08-05 22:55:00 on dist-test-slave-gmjp"
server_key: "5033f1d0522f586f0924627b02b9c9e9"
server_key_iv: "2228ab8bf8cbe6c29a208244f1aac8ad"
server_key_version: "encryptionkey@0"
I20260805 22:55:00.184686 1909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:00.203449 1909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:00.204497 1909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:00.204842 1909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:00.205914 1909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:00.207455 1909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:00.207598 1909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:00.207746 1909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:00.207839 1909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:00.243827 1909 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:44245
I20260805 22:55:00.243884 2092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:44245 every 8 connection(s)
I20260805 22:55:00.245325 1909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:55:00.249980 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 1909
I20260805 22:55:00.250205 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:55:00.250869 20617 external_mini_cluster.cc:1428] Setting key 7a19dbfa78057245230e48512893e3c3
I20260805 22:55:00.253841 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43781
--builtin_ntp_servers=127.20.34.84:38899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260805 22:55:00.258927 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:00.248096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:56585 (local address 127.20.34.126:43781)
0805 22:55:00.248653 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:00.248658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:00.249801 (+ 1143us) server_negotiation.cc:407] Connection header received
0805 22:55:00.251935 (+ 2134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:00.251940 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:00.252046 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:00.252186 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:00.253488 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:00.254324 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:00.255966 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:00.256449 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:00.256596 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:00.258014 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:00.258019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:00.258022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:00.258042 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:00.258081 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:00.258093 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:00.258191 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:00.258431 (+ 240us) server_negotiation.cc:299] Negotiation successful
0805 22:55:00.258547 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":327,"threads_started":1}
I20260805 22:55:00.260017 2098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:00.248672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43781 (local address 127.20.34.65:56585)
0805 22:55:00.249628 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:00.249665 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:00.251608 (+ 1943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:00.252462 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:00.252471 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:00.252563 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:00.253303 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:00.253321 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:00.254501 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:00.254505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:00.255788 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:00.255801 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:00.256692 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:00.256700 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:00.256943 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:00.257670 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:55:00.257673 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:00.257714 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:55:00.257794 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:00.258193 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:00.258208 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:00.258218 (+ 10us) client_negotiation.cc:769] Sending connection context
0805 22:55:00.258422 (+ 204us) client_negotiation.cc:240] Negotiation successful
0805 22:55:00.258853 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":304,"threads_started":1}
I20260805 22:55:00.261780 2093 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43781
I20260805 22:55:00.262126 2093 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:00.262948 2093 heartbeater.cc:511] Master 127.20.34.126:43781 requested a full tablet report, sending...
I20260805 22:55:00.265410 1818 ts_manager.cc:194] Registered new tserver with Master: 20ee8566061140d5957bc99b3b2d9ab2 (127.20.34.65:44245)
I20260805 22:55:00.267310 1818 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.65:56585
W20260805 22:55:00.620293 2099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:00.620620 2099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:00.620761 2099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:00.628420 2099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:00.628531 2099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:00.628716 2099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:55:00.641155 2099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:00.642851 2099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:00.645269 2099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:00.660908 2105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:00.660864 2106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:00.660948 2110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:00.661593 2099 server_base.cc:1034] running on GCE node
I20260805 22:55:00.662358 2099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:00.663352 2099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:00.664573 2099 hybrid_clock.cc:648] HybridClock initialized: now 1785970500664511 us; error 60 us; skew 500 ppm
I20260805 22:55:00.664932 2099 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:55:00.667227 2099 webserver.cc:460] Webserver started at http://127.20.34.66:38775/ using document root <none> and password file <none>
I20260805 22:55:00.667977 2099 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:00.668110 2099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:00.668514 2099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:00.671494 2099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "07b266414c794ee3b7a32e0d47b3262a"
format_stamp: "Formatted at 2026-08-05 22:55:00 on dist-test-slave-gmjp"
server_key: "db3e189b098be779504072c129822c77"
server_key_iv: "94bfa37645141ac7eece0b42463327c4"
server_key_version: "encryptionkey@0"
I20260805 22:55:00.672399 2099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "07b266414c794ee3b7a32e0d47b3262a"
format_stamp: "Formatted at 2026-08-05 22:55:00 on dist-test-slave-gmjp"
server_key: "db3e189b098be779504072c129822c77"
server_key_iv: "94bfa37645141ac7eece0b42463327c4"
server_key_version: "encryptionkey@0"
I20260805 22:55:00.677894 2099 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:55:00.681576 2119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:00.682989 2099 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:55:00.683182 2099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "07b266414c794ee3b7a32e0d47b3262a"
format_stamp: "Formatted at 2026-08-05 22:55:00 on dist-test-slave-gmjp"
server_key: "db3e189b098be779504072c129822c77"
server_key_iv: "94bfa37645141ac7eece0b42463327c4"
server_key_version: "encryptionkey@0"
I20260805 22:55:00.683418 2099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:00.711210 2099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:00.712265 2099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:00.712621 2099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:00.713732 2099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:00.715349 2099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:00.715487 2099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:00.715612 2099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:00.715700 2099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:00.751860 2099 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:34913
I20260805 22:55:00.751955 2285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:34913 every 8 connection(s)
I20260805 22:55:00.753266 2099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:55:00.758860 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 2099
I20260805 22:55:00.759039 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:55:00.759608 20617 external_mini_cluster.cc:1428] Setting key f11432b123a1cd537a6a58eb03a8065d
I20260805 22:55:00.763072 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43781
--builtin_ntp_servers=127.20.34.84:38899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260805 22:55:00.768133 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:00.755918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:51417 (local address 127.20.34.126:43781)
0805 22:55:00.756137 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:00.756144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:00.757614 (+ 1470us) server_negotiation.cc:407] Connection header received
0805 22:55:00.759934 (+ 2320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:00.759938 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:00.760018 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:00.760122 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:00.761447 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:00.762433 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:00.765024 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:00.765427 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:00.765530 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:00.767303 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:00.767308 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:00.767311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:00.767331 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:00.767369 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:00.767381 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:00.767461 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:00.767805 (+ 344us) server_negotiation.cc:299] Negotiation successful
0805 22:55:00.767895 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 22:55:00.769745 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:00.756519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43781 (local address 127.20.34.66:51417)
0805 22:55:00.757461 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:00.757497 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:00.759600 (+ 2103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:00.760435 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:00.760444 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:00.760546 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:00.761273 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:00.761291 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:00.762619 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:00.762627 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:00.764853 (+ 2226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:00.764873 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:00.765677 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:00.765687 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:00.766047 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:00.766873 (+ 826us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:55:00.766877 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:00.766934 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:55:00.767053 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:00.767487 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:00.767500 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:00.767511 (+ 11us) client_negotiation.cc:769] Sending connection context
0805 22:55:00.767743 (+ 232us) client_negotiation.cc:240] Negotiation successful
0805 22:55:00.768234 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":295,"threads_started":1}
I20260805 22:55:00.771317 2286 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43781
I20260805 22:55:00.771672 2286 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:00.772670 2286 heartbeater.cc:511] Master 127.20.34.126:43781 requested a full tablet report, sending...
I20260805 22:55:00.774307 1818 ts_manager.cc:194] Registered new tserver with Master: 07b266414c794ee3b7a32e0d47b3262a (127.20.34.66:34913)
I20260805 22:55:00.775142 1818 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.66:51417
W20260805 22:55:01.128062 2289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:01.128449 2289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:01.128558 2289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:01.136144 2289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:01.136348 2289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:01.136463 2289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:55:01.146164 2289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43781
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:01.147589 2289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:01.149663 2289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:01.163867 2300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:01.163899 2297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:01.163873 2296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:01.164858 2289 server_base.cc:1034] running on GCE node
I20260805 22:55:01.165648 2289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:01.166723 2289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:01.168011 2289 hybrid_clock.cc:648] HybridClock initialized: now 1785970501167947 us; error 75 us; skew 500 ppm
I20260805 22:55:01.168545 2289 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:55:01.171017 2289 webserver.cc:460] Webserver started at http://127.20.34.67:42369/ using document root <none> and password file <none>
I20260805 22:55:01.171788 2289 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:01.171931 2289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:01.172415 2289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:01.178402 2289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "2bc4f17fa7ba4fd0bd99d234a868f802"
format_stamp: "Formatted at 2026-08-05 22:55:01 on dist-test-slave-gmjp"
server_key: "dbeb65de4a5eac694026b78d753b893f"
server_key_iv: "86ff2487fee52830ddea07c24ca50a32"
server_key_version: "encryptionkey@0"
I20260805 22:55:01.179258 2289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "2bc4f17fa7ba4fd0bd99d234a868f802"
format_stamp: "Formatted at 2026-08-05 22:55:01 on dist-test-slave-gmjp"
server_key: "dbeb65de4a5eac694026b78d753b893f"
server_key_iv: "86ff2487fee52830ddea07c24ca50a32"
server_key_version: "encryptionkey@0"
I20260805 22:55:01.185705 2289 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 22:55:01.191303 2309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:01.193969 2289 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260805 22:55:01.194211 2289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "2bc4f17fa7ba4fd0bd99d234a868f802"
format_stamp: "Formatted at 2026-08-05 22:55:01 on dist-test-slave-gmjp"
server_key: "dbeb65de4a5eac694026b78d753b893f"
server_key_iv: "86ff2487fee52830ddea07c24ca50a32"
server_key_version: "encryptionkey@0"
I20260805 22:55:01.194478 2289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:01.222839 2289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:01.223835 2289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:01.224190 2289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:01.225272 2289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:01.226974 2289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:01.227108 2289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:01.227252 2289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:01.227358 2289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:01.263509 2289 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:43875
I20260805 22:55:01.263577 2474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:43875 every 8 connection(s)
I20260805 22:55:01.265033 2289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:55:01.268652 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 2289
I20260805 22:55:01.268839 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:55:01.269304 20617 external_mini_cluster.cc:1428] Setting key f1c14ff4607486436a0c9da75f11a315
I20260805 22:55:01.270879 2093 heartbeater.cc:503] Master 127.20.34.126:43781 was elected leader, sending a full tablet report...
I20260805 22:55:01.278875 2096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:01.267787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:42129 (local address 127.20.34.126:43781)
0805 22:55:01.268037 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:01.268043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:01.269917 (+ 1874us) server_negotiation.cc:407] Connection header received
0805 22:55:01.272514 (+ 2597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:01.272522 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:01.272608 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:01.272717 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:01.273902 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.274654 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.276252 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.276672 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.276770 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:01.278160 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:01.278165 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:01.278169 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:01.278189 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:01.278223 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:01.278235 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:01.278307 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:01.278537 (+ 230us) server_negotiation.cc:299] Negotiation successful
0805 22:55:01.278627 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260805 22:55:01.280084 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:01.268532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43781 (local address 127.20.34.67:42129)
0805 22:55:01.269708 (+ 1176us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:01.269766 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:01.272219 (+ 2453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:01.273016 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:01.273025 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:01.273127 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:01.273738 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:01.273756 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.274782 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.274786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:01.276070 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:01.276082 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.276896 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.276901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:01.277113 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:01.277812 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:55:01.277815 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:01.277859 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:55:01.277970 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:01.278322 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:01.278330 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:01.278336 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:55:01.278508 (+ 172us) client_negotiation.cc:240] Negotiation successful
0805 22:55:01.278840 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":429,"threads_started":1}
I20260805 22:55:01.281811 2475 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43781
I20260805 22:55:01.282156 2475 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:01.282968 2475 heartbeater.cc:511] Master 127.20.34.126:43781 requested a full tablet report, sending...
I20260805 22:55:01.284679 1817 ts_manager.cc:194] Registered new tserver with Master: 2bc4f17fa7ba4fd0bd99d234a868f802 (127.20.34.67:43875)
I20260805 22:55:01.285630 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:55:01.285909 1817 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.67:42129
W20260805 22:55:01.293186 2096 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:55:01.291305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54094 (local address 127.20.34.126:43781)
0805 22:55:01.291527 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:01.291531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:01.292061 (+ 530us) server_negotiation.cc:407] Connection header received
0805 22:55:01.292294 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:01.292298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:01.292363 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:01.292481 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:01.292868 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54094: BlockingRecv error: recv got EOF from 127.0.0.1:54094 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 22:55:01.294291 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 1909
I20260805 22:55:01.303133 2487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:01.295357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53174 (local address 127.20.34.65:44245)
0805 22:55:01.296014 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:01.296021 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:01.296050 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:55:01.296112 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:01.296119 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:01.296424 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:01.296557 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:01.296981 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.298012 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.299540 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.300322 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.300435 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:01.301616 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:01.301626 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:01.301641 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:01.302278 (+ 637us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:01.302327 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:01.302360 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:01.302470 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:01.302643 (+ 173us) server_negotiation.cc:299] Negotiation successful
0805 22:55:01.302770 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":320,"threads_started":1}
I20260805 22:55:01.304694 2088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:01.390800 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 1909
I20260805 22:55:01.417999 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 2099
I20260805 22:55:01.426542 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:01.419096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55244 (local address 127.20.34.66:34913)
0805 22:55:01.419725 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:01.419733 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:01.419762 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:55:01.419827 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:01.419833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:01.420088 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:01.420444 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:01.420816 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.421827 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.423023 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.423596 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.423699 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:01.424965 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:01.424973 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:01.424989 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:01.425611 (+ 622us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:01.425660 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:01.425680 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:01.425775 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:01.425994 (+ 219us) server_negotiation.cc:299] Negotiation successful
0805 22:55:01.426164 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":346,"threads_started":1}
I20260805 22:55:01.427907 2279 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:01.513504 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 2099
I20260805 22:55:01.541424 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 2289
I20260805 22:55:01.550474 2491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:01.542566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57854 (local address 127.20.34.67:43875)
0805 22:55:01.543287 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:01.543294 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:01.543327 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:55:01.543391 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:01.543397 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:01.543627 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:01.543761 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:01.544359 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.545450 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.546947 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:01.547529 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:01.547632 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:01.548919 (+ 1287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:01.548928 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:01.548943 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:01.549567 (+ 624us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:01.549617 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:01.549639 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:01.549750 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:01.549910 (+ 160us) server_negotiation.cc:299] Negotiation successful
0805 22:55:01.550063 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":395,"threads_started":1}
I20260805 22:55:01.551921 2465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:01.639109 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 2289
I20260805 22:55:01.666306 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 1775
I20260805 22:55:01.667685 1864 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:01.776646 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 1775
2026-08-05T22:55:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2710 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-05T22:55:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:55:01Z Disabled control of system clock
I20260805 22:55:01.880709 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45705
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:37523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:45705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 22:55:02.257632 2499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:02.257982 2499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:02.258071 2499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:02.265796 2499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:55:02.265944 2499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:02.265985 2499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:02.266151 2499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:55:02.266258 2499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:55:02.276677 2499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:45705
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:45705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:02.278225 2499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:02.280381 2499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:02.293440 2508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:02.293398 2504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:02.293511 2505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:02.295070 2499 server_base.cc:1034] running on GCE node
I20260805 22:55:02.296131 2499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:02.297979 2499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:02.299218 2499 hybrid_clock.cc:648] HybridClock initialized: now 1785970502299167 us; error 47 us; skew 500 ppm
I20260805 22:55:02.299643 2499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:55:02.302460 2499 webserver.cc:460] Webserver started at http://127.20.34.126:44379/ using document root <none> and password file <none>
I20260805 22:55:02.303290 2499 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:02.303417 2499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:02.303789 2499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:02.307085 2499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "2d50c5aa13c443db917f02fe806f47d4"
format_stamp: "Formatted at 2026-08-05 22:55:02 on dist-test-slave-gmjp"
server_key: "8e847bc2b8c5244db5fa0dab44a97079"
server_key_iv: "1ad83b2038e46ebe693b14eb07d5d559"
server_key_version: "encryptionkey@0"
I20260805 22:55:02.308008 2499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "2d50c5aa13c443db917f02fe806f47d4"
format_stamp: "Formatted at 2026-08-05 22:55:02 on dist-test-slave-gmjp"
server_key: "8e847bc2b8c5244db5fa0dab44a97079"
server_key_iv: "1ad83b2038e46ebe693b14eb07d5d559"
server_key_version: "encryptionkey@0"
I20260805 22:55:02.313820 2499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260805 22:55:02.317713 2517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:02.319337 2499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:55:02.319582 2499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "2d50c5aa13c443db917f02fe806f47d4"
format_stamp: "Formatted at 2026-08-05 22:55:02 on dist-test-slave-gmjp"
server_key: "8e847bc2b8c5244db5fa0dab44a97079"
server_key_iv: "1ad83b2038e46ebe693b14eb07d5d559"
server_key_version: "encryptionkey@0"
I20260805 22:55:02.319882 2499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:02.326649 2499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:02.327641 2499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:02.328024 2499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:02.349700 2499 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:45705
I20260805 22:55:02.349756 2591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:45705 every 8 connection(s)
I20260805 22:55:02.351270 2499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:55:02.355768 2593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:55:02.355765 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 2499
I20260805 22:55:02.356010 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:55:02.356729 20617 external_mini_cluster.cc:1428] Setting key a4ae51e892ef0e679fd027816e835a53
I20260805 22:55:02.366330 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:02.358937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60186 (local address 127.20.34.126:45705)
0805 22:55:02.360105 (+ 1168us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:02.360117 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:02.360230 (+ 113us) server_negotiation.cc:407] Connection header received
0805 22:55:02.362375 (+ 2145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:02.362420 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:02.362870 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:02.363215 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:02.364534 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:02.364541 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:02.364555 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:02.364570 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:02.364638 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:02.364655 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:02.364842 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:02.364995 (+ 153us) server_negotiation.cc:299] Negotiation successful
0805 22:55:02.365288 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":432,"threads_started":1}
I20260805 22:55:02.370409 2593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4: Bootstrap starting.
I20260805 22:55:02.374087 2593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4: Neither blocks nor log segments found. Creating new log.
I20260805 22:55:02.375267 2593 log.cc:824] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:55:02.378526 2593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4: No bootstrap required, opened a new log
I20260805 22:55:02.386489 2593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d50c5aa13c443db917f02fe806f47d4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45705 } }
I20260805 22:55:02.386916 2593 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:55:02.387029 2593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d50c5aa13c443db917f02fe806f47d4, State: Initialized, Role: FOLLOWER
I20260805 22:55:02.387676 2593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d50c5aa13c443db917f02fe806f47d4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45705 } }
I20260805 22:55:02.387928 2593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:55:02.388080 2593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:55:02.388326 2593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:55:02.390861 2593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d50c5aa13c443db917f02fe806f47d4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45705 } }
I20260805 22:55:02.391494 2593 leader_election.cc:302] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d50c5aa13c443db917f02fe806f47d4; no voters:
I20260805 22:55:02.392256 2593 leader_election.cc:288] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:55:02.392429 2602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:55:02.393260 2602 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [term 1 LEADER]: Becoming Leader. State: Replica: 2d50c5aa13c443db917f02fe806f47d4, State: Running, Role: LEADER
I20260805 22:55:02.393927 2602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d50c5aa13c443db917f02fe806f47d4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45705 } }
I20260805 22:55:02.394595 2593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:55:02.397409 2606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d50c5aa13c443db917f02fe806f47d4. Latest consensus state: current_term: 1 leader_uuid: "2d50c5aa13c443db917f02fe806f47d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d50c5aa13c443db917f02fe806f47d4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45705 } } }
I20260805 22:55:02.397728 2605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d50c5aa13c443db917f02fe806f47d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d50c5aa13c443db917f02fe806f47d4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 45705 } } }
I20260805 22:55:02.398047 2605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:55:02.398094 2606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:55:02.401856 2619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:55:02.406744 2619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:55:02.416898 2619 catalog_manager.cc:1347] Generated new cluster ID: 325c19e54e834927ae5001eaee9e711d
I20260805 22:55:02.417088 2619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:55:02.440935 2619 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:55:02.441411 2619 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:55:02.451222 2619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d50c5aa13c443db917f02fe806f47d4: Generated new TSK 0
I20260805 22:55:02.452436 2619 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:55:02.467727 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45705
--builtin_ntp_servers=127.20.34.84:37523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 22:55:02.837214 2636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:02.837527 2636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:02.837697 2636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:02.845455 2636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:02.845584 2636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:02.845765 2636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:55:02.855583 2636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:02.857065 2636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:02.859019 2636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:02.873291 2647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:02.873395 2651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:02.873342 2648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:02.874368 2636 server_base.cc:1034] running on GCE node
I20260805 22:55:02.875018 2636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:02.876085 2636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:02.877368 2636 hybrid_clock.cc:648] HybridClock initialized: now 1785970502877312 us; error 52 us; skew 500 ppm
I20260805 22:55:02.877748 2636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:55:02.883965 2636 webserver.cc:460] Webserver started at http://127.20.34.65:45029/ using document root <none> and password file <none>
I20260805 22:55:02.884858 2636 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:02.885020 2636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:02.885394 2636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:02.888687 2636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "9415fcb1973e45c1953663e7d7a3c8bf"
format_stamp: "Formatted at 2026-08-05 22:55:02 on dist-test-slave-gmjp"
server_key: "1d0d1f705e1e04884cd8117e9c1b28a5"
server_key_iv: "99f8700f9af706692d032e4dedb2e670"
server_key_version: "encryptionkey@0"
I20260805 22:55:02.889580 2636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "9415fcb1973e45c1953663e7d7a3c8bf"
format_stamp: "Formatted at 2026-08-05 22:55:02 on dist-test-slave-gmjp"
server_key: "1d0d1f705e1e04884cd8117e9c1b28a5"
server_key_iv: "99f8700f9af706692d032e4dedb2e670"
server_key_version: "encryptionkey@0"
I20260805 22:55:02.895674 2636 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 22:55:02.899973 2658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:02.901602 2636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:55:02.901808 2636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "9415fcb1973e45c1953663e7d7a3c8bf"
format_stamp: "Formatted at 2026-08-05 22:55:02 on dist-test-slave-gmjp"
server_key: "1d0d1f705e1e04884cd8117e9c1b28a5"
server_key_iv: "99f8700f9af706692d032e4dedb2e670"
server_key_version: "encryptionkey@0"
I20260805 22:55:02.902074 2636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:02.908550 2636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:02.909479 2636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:02.909791 2636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:02.910902 2636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:02.912609 2636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:02.912745 2636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:02.912902 2636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:02.912997 2636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:02.950016 2636 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:40741
I20260805 22:55:02.950052 2833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:40741 every 8 connection(s)
I20260805 22:55:02.951593 2636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:55:02.952296 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 2636
I20260805 22:55:02.952546 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:55:02.953441 20617 external_mini_cluster.cc:1428] Setting key 3727355a74342ea266f23b54b631028f
I20260805 22:55:02.956825 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45705
--builtin_ntp_servers=127.20.34.84:37523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260805 22:55:02.961369 2837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:02.954625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:46773 (local address 127.20.34.126:45705)
0805 22:55:02.955187 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:02.955191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:02.956753 (+ 1562us) server_negotiation.cc:407] Connection header received
0805 22:55:02.958578 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:02.958586 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:02.958659 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:02.958788 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:02.960392 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:02.960400 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:02.960408 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:02.960431 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:02.960494 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:02.960514 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:02.960654 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:02.960895 (+ 241us) server_negotiation.cc:299] Negotiation successful
0805 22:55:02.960969 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":324,"threads_started":1}
I20260805 22:55:02.962227 2838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:02.955356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45705 (local address 127.20.34.65:46773)
0805 22:55:02.956566 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:02.956622 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:02.958273 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:02.959089 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:02.959097 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:02.959198 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:02.959986 (+ 788us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:55:02.959989 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:02.960029 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:55:02.960124 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:02.960624 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:02.960633 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:02.960639 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:55:02.960916 (+ 277us) client_negotiation.cc:240] Negotiation successful
0805 22:55:02.961135 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":392,"threads_started":1}
I20260805 22:55:02.963910 2835 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45705
I20260805 22:55:02.964283 2835 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:02.965057 2835 heartbeater.cc:511] Master 127.20.34.126:45705 requested a full tablet report, sending...
I20260805 22:55:02.967670 2540 ts_manager.cc:194] Registered new tserver with Master: 9415fcb1973e45c1953663e7d7a3c8bf (127.20.34.65:40741)
W20260805 22:55:03.323902 2839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:03.324316 2839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:03.324479 2839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:03.332065 2839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:03.332259 2839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:03.332489 2839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:55:03.342247 2839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:03.343672 2839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:03.345696 2839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:03.360939 2849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:03.360898 2848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:03.361687 2857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:03.362100 2839 server_base.cc:1034] running on GCE node
I20260805 22:55:03.362869 2839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:03.364120 2839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:03.365414 2839 hybrid_clock.cc:648] HybridClock initialized: now 1785970503365349 us; error 50 us; skew 500 ppm
I20260805 22:55:03.365866 2839 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:55:03.369110 2839 webserver.cc:460] Webserver started at http://127.20.34.66:43751/ using document root <none> and password file <none>
I20260805 22:55:03.370083 2839 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:03.370235 2839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:03.370788 2839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:03.374148 2839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "dad89968aa384c4ca082d2edf96f94df"
format_stamp: "Formatted at 2026-08-05 22:55:03 on dist-test-slave-gmjp"
server_key: "5ccad72ec26cdfecbd73df8df8b04755"
server_key_iv: "1893f5e9699a842ab85b6e4d1d1aba07"
server_key_version: "encryptionkey@0"
I20260805 22:55:03.375036 2839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "dad89968aa384c4ca082d2edf96f94df"
format_stamp: "Formatted at 2026-08-05 22:55:03 on dist-test-slave-gmjp"
server_key: "5ccad72ec26cdfecbd73df8df8b04755"
server_key_iv: "1893f5e9699a842ab85b6e4d1d1aba07"
server_key_version: "encryptionkey@0"
I20260805 22:55:03.381367 2839 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260805 22:55:03.385300 2864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:03.386860 2839 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:55:03.387058 2839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "dad89968aa384c4ca082d2edf96f94df"
format_stamp: "Formatted at 2026-08-05 22:55:03 on dist-test-slave-gmjp"
server_key: "5ccad72ec26cdfecbd73df8df8b04755"
server_key_iv: "1893f5e9699a842ab85b6e4d1d1aba07"
server_key_version: "encryptionkey@0"
I20260805 22:55:03.387315 2839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:03.393419 2839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:03.394426 2839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:03.394788 2839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:03.395922 2839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:03.397686 2839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:03.397781 2839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:03.397923 2839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:03.398008 2839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:03.434528 2839 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:38783
I20260805 22:55:03.434614 3036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:38783 every 8 connection(s)
I20260805 22:55:03.435963 2839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:55:03.442021 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 2839
I20260805 22:55:03.442227 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:55:03.442693 20617 external_mini_cluster.cc:1428] Setting key 76e0fd04e846f5c69759f5a7d29a6d7f
I20260805 22:55:03.444747 2837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:03.438788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:52975 (local address 127.20.34.126:45705)
0805 22:55:03.439025 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:03.439032 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:03.440482 (+ 1450us) server_negotiation.cc:407] Connection header received
0805 22:55:03.442254 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:03.442263 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:03.442385 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:03.442514 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:03.443941 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:03.443946 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:03.443950 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:03.443966 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:03.444000 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:03.444012 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:03.444131 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:03.444398 (+ 267us) server_negotiation.cc:299] Negotiation successful
0805 22:55:03.444456 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:55:03.445827 3040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:03.439316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45705 (local address 127.20.34.66:52975)
0805 22:55:03.440301 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:03.440360 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:03.441916 (+ 1556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:03.442763 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:03.442772 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:03.442913 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:03.443605 (+ 692us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:55:03.443608 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:03.443647 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:55:03.443740 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:03.444127 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:03.444138 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:03.444146 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 22:55:03.444480 (+ 334us) client_negotiation.cc:240] Negotiation successful
0805 22:55:03.444800 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":274,"threads_started":1}
I20260805 22:55:03.446151 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45705
--builtin_ntp_servers=127.20.34.84:37523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260805 22:55:03.447444 3037 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45705
I20260805 22:55:03.447775 3037 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:03.448508 3037 heartbeater.cc:511] Master 127.20.34.126:45705 requested a full tablet report, sending...
I20260805 22:55:03.450037 2540 ts_manager.cc:194] Registered new tserver with Master: dad89968aa384c4ca082d2edf96f94df (127.20.34.66:38783)
W20260805 22:55:03.825472 3041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:03.825799 3041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:03.825894 3041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:03.833566 3041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:03.833693 3041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:03.833817 3041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:55:03.843665 3041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:45705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:03.845139 3041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:03.846988 3041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:03.861783 3050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:03.861800 3049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:03.861738 3053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:03.862823 3041 server_base.cc:1034] running on GCE node
I20260805 22:55:03.863451 3041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:03.864537 3041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:03.865784 3041 hybrid_clock.cc:648] HybridClock initialized: now 1785970503865733 us; error 44 us; skew 500 ppm
I20260805 22:55:03.866137 3041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:55:03.868815 3041 webserver.cc:460] Webserver started at http://127.20.34.67:43401/ using document root <none> and password file <none>
I20260805 22:55:03.869588 3041 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:03.869680 3041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:03.870023 3041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:03.873056 3041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "db3a5b44b2bb4f0187ef3734bdaa70c4"
format_stamp: "Formatted at 2026-08-05 22:55:03 on dist-test-slave-gmjp"
server_key: "a59c04291eb109b4430296dfb3bf1f24"
server_key_iv: "8b9acb5691d1cb49d27b1f22d752b767"
server_key_version: "encryptionkey@0"
I20260805 22:55:03.873839 3041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "db3a5b44b2bb4f0187ef3734bdaa70c4"
format_stamp: "Formatted at 2026-08-05 22:55:03 on dist-test-slave-gmjp"
server_key: "a59c04291eb109b4430296dfb3bf1f24"
server_key_iv: "8b9acb5691d1cb49d27b1f22d752b767"
server_key_version: "encryptionkey@0"
I20260805 22:55:03.879479 3041 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:55:03.883527 3070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:03.885267 3041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:55:03.885468 3041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "db3a5b44b2bb4f0187ef3734bdaa70c4"
format_stamp: "Formatted at 2026-08-05 22:55:03 on dist-test-slave-gmjp"
server_key: "a59c04291eb109b4430296dfb3bf1f24"
server_key_iv: "8b9acb5691d1cb49d27b1f22d752b767"
server_key_version: "encryptionkey@0"
I20260805 22:55:03.885715 3041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:03.892280 3041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:03.893190 3041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:03.893486 3041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:03.894512 3041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:03.896351 3041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:03.896467 3041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:03.896600 3041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:03.896690 3041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:03.933117 3041 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:40633
I20260805 22:55:03.933223 3241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:40633 every 8 connection(s)
I20260805 22:55:03.934619 3041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:55:03.941375 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 3041
I20260805 22:55:03.941615 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:55:03.942080 20617 external_mini_cluster.cc:1428] Setting key 8fb62e03349b239e6928bcf59995350e
I20260805 22:55:03.944075 2837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:03.937636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:46607 (local address 127.20.34.126:45705)
0805 22:55:03.937930 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:03.937935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:03.939412 (+ 1477us) server_negotiation.cc:407] Connection header received
0805 22:55:03.941455 (+ 2043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:03.941462 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:03.941547 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:03.941700 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:03.943264 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:03.943269 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:03.943273 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:03.943289 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:03.943325 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:03.943337 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:03.943480 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:03.943720 (+ 240us) server_negotiation.cc:299] Negotiation successful
0805 22:55:03.943793 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260805 22:55:03.945441 3246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:03.938193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:45705 (local address 127.20.34.67:46607)
0805 22:55:03.939220 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:03.939262 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:03.941052 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:03.941980 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:03.941989 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:03.942091 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:03.942905 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:55:03.942911 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:03.942969 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:55:03.943082 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:03.943449 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:03.943466 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:03.943491 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:55:03.943823 (+ 332us) client_negotiation.cc:240] Negotiation successful
0805 22:55:03.944115 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":341,"threads_started":1}
I20260805 22:55:03.946859 3243 heartbeater.cc:347] Connected to a master server at 127.20.34.126:45705
I20260805 22:55:03.947152 3243 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:03.947715 3243 heartbeater.cc:511] Master 127.20.34.126:45705 requested a full tablet report, sending...
I20260805 22:55:03.949295 2540 ts_manager.cc:194] Registered new tserver with Master: db3a5b44b2bb4f0187ef3734bdaa70c4 (127.20.34.67:40633)
I20260805 22:55:03.958554 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 22:55:03.965307 2837 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:55:03.963475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60192 (local address 127.20.34.126:45705)
0805 22:55:03.963668 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:03.963673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:03.964308 (+ 635us) server_negotiation.cc:407] Connection header received
0805 22:55:03.964476 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:03.964480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:03.964541 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:03.964635 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:03.965074 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60192: BlockingRecv error: recv got EOF from 127.0.0.1:60192 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 22:55:03.965945 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 2636
I20260805 22:55:03.970726 3257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:03.967495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50448 (local address 127.20.34.65:40741)
0805 22:55:03.968240 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:03.968253 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:03.968288 (+ 35us) server_negotiation.cc:407] Connection header received
0805 22:55:03.968358 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:03.968366 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:03.968602 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:03.968740 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:03.969873 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:03.969881 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:03.969893 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:03.969906 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:03.969954 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:03.969970 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:03.970181 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:03.970329 (+ 148us) server_negotiation.cc:299] Negotiation successful
0805 22:55:03.970423 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":325,"threads_started":1}
I20260805 22:55:03.971225 2835 heartbeater.cc:503] Master 127.20.34.126:45705 was elected leader, sending a full tablet report...
I20260805 22:55:03.972357 2828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:04.064919 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 2636
I20260805 22:55:04.088841 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 2839
I20260805 22:55:04.092770 3259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:04.089923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56902 (local address 127.20.34.66:38783)
0805 22:55:04.090490 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:04.090497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:04.090528 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:55:04.090597 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:04.090603 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:04.090826 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:04.091033 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:04.092057 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:04.092066 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:04.092086 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:04.092100 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:04.092147 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:04.092217 (+ 70us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:04.092341 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:04.092440 (+ 99us) server_negotiation.cc:299] Negotiation successful
0805 22:55:04.092531 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":255,"threads_started":1}
I20260805 22:55:04.094053 3030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:04.178001 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 2839
I20260805 22:55:04.208671 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 3041
I20260805 22:55:04.213230 3261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:04.209696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42722 (local address 127.20.34.67:40633)
0805 22:55:04.210414 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:04.210422 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:04.210454 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:55:04.210521 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:04.210528 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:04.210770 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:04.210966 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:04.212391 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:04.212398 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:04.212412 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:55:04.212426 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:04.212467 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:55:04.212482 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:04.212684 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:04.212770 (+ 86us) server_negotiation.cc:299] Negotiation successful
0805 22:55:04.212896 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":358,"threads_started":1}
I20260805 22:55:04.214593 3235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:04.298566 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 3041
I20260805 22:55:04.325968 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 2499
I20260805 22:55:04.327392 2586 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:04.434687 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 2499
2026-08-05T22:55:04Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2656 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:55:04 dist-test-slave-gmjp krb5kdc[3269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:55:04 dist-test-slave-gmjp krb5kdc[3269](info): set up 2 sockets
Aug 05 22:55:04 dist-test-slave-gmjp krb5kdc[3269](info): commencing operation
krb5kdc: starting...
W20260805 22:55:05.774322 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.289s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:55:05 dist-test-slave-gmjp krb5kdc[3269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:55:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:55:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:55:06.118134 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43163
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:43163
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:55:06.502178 3290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:06.502513 3290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:06.502671 3290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:06.510776 3290 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:55:06.510918 3290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:06.511035 3290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:06.511122 3290 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:55:06.511204 3290 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:55:06.521965 3290 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:43163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:06.523495 3290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:06.525058 3290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:06.537840 3296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:06.537925 3297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:06.537886 3299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:06.539117 3290 server_base.cc:1034] running on GCE node
I20260805 22:55:06.539971 3290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:06.541539 3290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:06.542788 3290 hybrid_clock.cc:648] HybridClock initialized: now 1785970506542741 us; error 58 us; skew 500 ppm
I20260805 22:55:06.543156 3290 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:55:06 dist-test-slave-gmjp krb5kdc[3269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970506, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:55:06.546463 3290 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:55:06.548280 3290 webserver.cc:460] Webserver started at http://127.20.34.126:42291/ using document root <none> and password file <none>
I20260805 22:55:06.549078 3290 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:06.549240 3290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:06.549588 3290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:06.552953 3290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "5ac40fee049f45a5aca59ff792964b55"
format_stamp: "Formatted at 2026-08-05 22:55:06 on dist-test-slave-gmjp"
server_key: "5987dc16e65ac8c9a92713c65a4fe997"
server_key_iv: "906e47ecb81958756eedca897f345163"
server_key_version: "encryptionkey@0"
I20260805 22:55:06.553773 3290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "5ac40fee049f45a5aca59ff792964b55"
format_stamp: "Formatted at 2026-08-05 22:55:06 on dist-test-slave-gmjp"
server_key: "5987dc16e65ac8c9a92713c65a4fe997"
server_key_iv: "906e47ecb81958756eedca897f345163"
server_key_version: "encryptionkey@0"
I20260805 22:55:06.559294 3290 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:55:06.563185 3311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:06.564687 3290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:55:06.564900 3290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "5ac40fee049f45a5aca59ff792964b55"
format_stamp: "Formatted at 2026-08-05 22:55:06 on dist-test-slave-gmjp"
server_key: "5987dc16e65ac8c9a92713c65a4fe997"
server_key_iv: "906e47ecb81958756eedca897f345163"
server_key_version: "encryptionkey@0"
I20260805 22:55:06.565124 3290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:06.581892 3290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:06.586414 3290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:06.586755 3290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:06.607350 3290 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:43163
I20260805 22:55:06.607381 3386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:43163 every 8 connection(s)
I20260805 22:55:06.608908 3290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:55:06.613081 3387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:55:06.614276 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 3290
I20260805 22:55:06.614562 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:55:06.615460 20617 external_mini_cluster.cc:1428] Setting key 73adf63ccc70e2e3830d39ec7065c3bd
I20260805 22:55:06.629279 3387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55: Bootstrap starting.
Aug 05 22:55:06 dist-test-slave-gmjp krb5kdc[3269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:55:06.633394 3387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55: Neither blocks nor log segments found. Creating new log.
I20260805 22:55:06.634649 3387 log.cc:824] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55: Log is configured to *not* fsync() on all Append() calls
I20260805 22:55:06.638835 3387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55: No bootstrap required, opened a new log
I20260805 22:55:06.642498 3391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:06.617933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58346 (local address 127.20.34.126:43163)
0805 22:55:06.618882 (+ 949us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:06.618894 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:06.618944 (+ 50us) server_negotiation.cc:407] Connection header received
0805 22:55:06.620710 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:06.620738 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:06.621191 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:06.621557 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:06.623553 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:06.625051 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:06.627010 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:06.627777 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:06.627919 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:06.633010 (+ 5091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:06.633021 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:06.633040 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:06.633095 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:06.637582 (+ 4487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:06.638662 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:06.638672 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:06.638683 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:06.638891 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:06.639329 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:06.639338 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:06.639342 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:06.639939 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:06.640337 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:06.640907 (+ 570us) server_negotiation.cc:299] Negotiation successful
0805 22:55:06.641371 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":479,"threads_started":1}
I20260805 22:55:06.648286 3387 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac40fee049f45a5aca59ff792964b55" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43163 } }
I20260805 22:55:06.648746 3387 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:55:06.648871 3387 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac40fee049f45a5aca59ff792964b55, State: Initialized, Role: FOLLOWER
I20260805 22:55:06.649479 3387 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac40fee049f45a5aca59ff792964b55" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43163 } }
I20260805 22:55:06.649739 3387 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:55:06.649892 3387 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:55:06.650075 3387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:55:06.653016 3387 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac40fee049f45a5aca59ff792964b55" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43163 } }
I20260805 22:55:06.653607 3387 leader_election.cc:302] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ac40fee049f45a5aca59ff792964b55; no voters:
I20260805 22:55:06.654309 3387 leader_election.cc:288] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:55:06.654479 3393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:55:06.655349 3393 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [term 1 LEADER]: Becoming Leader. State: Replica: 5ac40fee049f45a5aca59ff792964b55, State: Running, Role: LEADER
I20260805 22:55:06.655951 3393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac40fee049f45a5aca59ff792964b55" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43163 } }
I20260805 22:55:06.656822 3387 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:55:06.659369 3398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ac40fee049f45a5aca59ff792964b55. Latest consensus state: current_term: 1 leader_uuid: "5ac40fee049f45a5aca59ff792964b55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac40fee049f45a5aca59ff792964b55" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43163 } } }
I20260805 22:55:06.659536 3395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ac40fee049f45a5aca59ff792964b55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac40fee049f45a5aca59ff792964b55" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43163 } } }
I20260805 22:55:06.659873 3395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [sys.catalog]: This master's current role is: LEADER
I20260805 22:55:06.659878 3398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55 [sys.catalog]: This master's current role is: LEADER
I20260805 22:55:06.662225 3406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:55:06.667166 3406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:55:06.676267 3406 catalog_manager.cc:1347] Generated new cluster ID: f6ed3c127d79443c9ea48f76d166eaa7
I20260805 22:55:06.676437 3406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:55:06.701709 3406 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:55:06.703230 3406 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:55:06.709721 3406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55: Generated new TSK 0
I20260805 22:55:06.710636 3406 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:55:06.791760 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43163
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:55:07.167132 3427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:07.167446 3427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:07.167611 3427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:07.175525 3427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:07.175684 3427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:07.175896 3427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:55:07.190048 3427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:07.191555 3427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:07.193151 3427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:07.208086 3436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:07.208124 3434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:07.208040 3432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:07.209079 3427 server_base.cc:1034] running on GCE node
I20260805 22:55:07.209714 3427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:07.210861 3427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:07.212198 3427 hybrid_clock.cc:648] HybridClock initialized: now 1785970507212082 us; error 63 us; skew 500 ppm
I20260805 22:55:07.212591 3427 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:55:07 dist-test-slave-gmjp krb5kdc[3269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970507, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:55:07.216197 3427 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:55:07.217818 3427 webserver.cc:460] Webserver started at http://127.20.34.65:42529/ using document root <none> and password file <none>
I20260805 22:55:07.218638 3427 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:07.218794 3427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:07.219135 3427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:07.222396 3427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "253bb4ec96c64d68a6f20e822b698824"
format_stamp: "Formatted at 2026-08-05 22:55:07 on dist-test-slave-gmjp"
server_key: "1fcd9ca54c76852e4fc39cb1bf636eb0"
server_key_iv: "66e3f77bba50f077ea8e44af4dce5c91"
server_key_version: "encryptionkey@0"
I20260805 22:55:07.223264 3427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "253bb4ec96c64d68a6f20e822b698824"
format_stamp: "Formatted at 2026-08-05 22:55:07 on dist-test-slave-gmjp"
server_key: "1fcd9ca54c76852e4fc39cb1bf636eb0"
server_key_iv: "66e3f77bba50f077ea8e44af4dce5c91"
server_key_version: "encryptionkey@0"
I20260805 22:55:07.229187 3427 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260805 22:55:07.233371 3445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:07.234941 3427 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260805 22:55:07.235162 3427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "253bb4ec96c64d68a6f20e822b698824"
format_stamp: "Formatted at 2026-08-05 22:55:07 on dist-test-slave-gmjp"
server_key: "1fcd9ca54c76852e4fc39cb1bf636eb0"
server_key_iv: "66e3f77bba50f077ea8e44af4dce5c91"
server_key_version: "encryptionkey@0"
I20260805 22:55:07.235415 3427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:07.254135 3427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:07.259637 3427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:07.260107 3427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:07.261590 3427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:07.263394 3427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:07.263492 3427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:07.263671 3427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:07.263772 3427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:07.301565 3427 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34031
I20260805 22:55:07.301614 3606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34031 every 8 connection(s)
I20260805 22:55:07.302987 3427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:55:07.308349 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 3427
I20260805 22:55:07.308589 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:55:07.309255 20617 external_mini_cluster.cc:1428] Setting key 35e7b68f665caf0465e9b69b9549449a
Aug 05 22:55:07 dist-test-slave-gmjp krb5kdc[3269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970507, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:55:07.325469 3610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:07.305889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:56583 (local address 127.20.34.126:43163)
0805 22:55:07.306430 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:07.306435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:07.307371 (+ 936us) server_negotiation.cc:407] Connection header received
0805 22:55:07.309572 (+ 2201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:07.309578 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:07.309679 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:07.309806 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:07.311724 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:07.312559 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:07.314330 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:07.314748 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:07.314902 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:07.319066 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:07.319072 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:07.319075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:07.319114 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:07.321913 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:07.322742 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:07.322750 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:07.322754 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:07.322892 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:07.323363 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:07.323369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:07.323374 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:07.323675 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:07.323843 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:07.324684 (+ 841us) server_negotiation.cc:299] Negotiation successful
0805 22:55:07.324931 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":286,"threads_started":1}
I20260805 22:55:07.326824 3611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:07.306415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43163 (local address 127.20.34.65:56583)
0805 22:55:07.307178 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:07.307227 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:07.309222 (+ 1995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:07.310151 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:07.310164 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:07.310784 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:07.311535 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:07.311557 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:07.312744 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:07.312748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:07.314129 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:07.314145 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:07.315037 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:07.315045 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:07.315304 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:07.316079 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:55:07.316112 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:07.318771 (+ 2659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:07.322096 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:55:07.322106 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:55:07.322133 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:55:07.322603 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:55:07.323017 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:55:07.323022 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:55:07.323026 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:55:07.323237 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:55:07.323817 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:07.323826 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:07.324281 (+ 455us) client_negotiation.cc:769] Sending connection context
0805 22:55:07.324584 (+ 303us) client_negotiation.cc:240] Negotiation successful
0805 22:55:07.325230 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":331,"threads_started":1}
I20260805 22:55:07.328663 3608 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43163
I20260805 22:55:07.329077 3608 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:07.330196 3608 heartbeater.cc:511] Master 127.20.34.126:43163 requested a full tablet report, sending...
I20260805 22:55:07.332814 3333 ts_manager.cc:194] Registered new tserver with Master: 253bb4ec96c64d68a6f20e822b698824 (127.20.34.65:34031)
I20260805 22:55:07.334394 3333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:56583
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:55:07.384366 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43163
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:55:07.762189 3614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:07.762501 3614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:07.762666 3614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:07.770323 3614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:07.770457 3614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:07.770655 3614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:55:07.781155 3614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:07.782631 3614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:07.784063 3614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:07.798144 3628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:07.798220 3625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:07.798223 3624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:07.799171 3614 server_base.cc:1034] running on GCE node
I20260805 22:55:07.799880 3614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:07.800976 3614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:07.802202 3614 hybrid_clock.cc:648] HybridClock initialized: now 1785970507802143 us; error 41 us; skew 500 ppm
I20260805 22:55:07.802526 3614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:55:07 dist-test-slave-gmjp krb5kdc[3269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970507, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:55:07.806103 3614 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:55:07.807756 3614 webserver.cc:460] Webserver started at http://127.20.34.66:43809/ using document root <none> and password file <none>
I20260805 22:55:07.808620 3614 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:07.808774 3614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:07.809115 3614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:07.812460 3614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "3559ed86d49c4dc788fc05e73a51db4e"
format_stamp: "Formatted at 2026-08-05 22:55:07 on dist-test-slave-gmjp"
server_key: "bea4c7d523587e5f6f715a2a31deebea"
server_key_iv: "a6dbc9013a87cfe7777f1a470dc5796a"
server_key_version: "encryptionkey@0"
I20260805 22:55:07.813362 3614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "3559ed86d49c4dc788fc05e73a51db4e"
format_stamp: "Formatted at 2026-08-05 22:55:07 on dist-test-slave-gmjp"
server_key: "bea4c7d523587e5f6f715a2a31deebea"
server_key_iv: "a6dbc9013a87cfe7777f1a470dc5796a"
server_key_version: "encryptionkey@0"
I20260805 22:55:07.819252 3614 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260805 22:55:07.822980 3635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:07.824585 3614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:55:07.824798 3614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "3559ed86d49c4dc788fc05e73a51db4e"
format_stamp: "Formatted at 2026-08-05 22:55:07 on dist-test-slave-gmjp"
server_key: "bea4c7d523587e5f6f715a2a31deebea"
server_key_iv: "a6dbc9013a87cfe7777f1a470dc5796a"
server_key_version: "encryptionkey@0"
I20260805 22:55:07.825085 3614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:07.853122 3614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:07.857671 3614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:07.858013 3614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:07.859190 3614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:07.860810 3614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:07.860924 3614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:07.861083 3614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:07.861156 3614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:07.897925 3614 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:43195
I20260805 22:55:07.897981 3809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:43195 every 8 connection(s)
I20260805 22:55:07.899415 3614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:55:07.909729 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 3614
I20260805 22:55:07.909984 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:55:07.910459 20617 external_mini_cluster.cc:1428] Setting key 948eedff09725475455b70001bf4c1c0
Aug 05 22:55:07 dist-test-slave-gmjp krb5kdc[3269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970507, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:55:07.925071 3813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:07.902202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:51723 (local address 127.20.34.126:43163)
0805 22:55:07.902696 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:07.902700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:07.903545 (+ 845us) server_negotiation.cc:407] Connection header received
0805 22:55:07.905671 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:07.905677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:07.905777 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:07.905908 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:07.907445 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:07.908222 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:07.909821 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:07.910369 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:07.910510 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:07.917406 (+ 6896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:07.917416 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:07.917425 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:07.917479 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:07.921276 (+ 3797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:07.922227 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:07.922236 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:07.922259 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:07.922440 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:07.922899 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:07.922907 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:07.922913 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:07.923348 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:07.923508 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:07.924279 (+ 771us) server_negotiation.cc:299] Negotiation successful
0805 22:55:07.924558 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":256,"threads_started":1}
I20260805 22:55:07.925897 3815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:07.902655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43163 (local address 127.20.34.66:51723)
0805 22:55:07.903376 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:07.903416 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:07.905381 (+ 1965us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:07.906150 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:07.906158 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:07.906680 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:07.907267 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:07.907284 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:07.908399 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:07.908403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:07.909645 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:07.909657 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:07.910614 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:07.910621 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:07.910909 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:07.914539 (+ 3630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:55:07.914567 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:07.917079 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:07.921473 (+ 4394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:55:07.921482 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:55:07.921498 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:55:07.922088 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:55:07.922556 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:55:07.922559 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:55:07.922561 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:55:07.922777 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:55:07.923480 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:07.923488 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:07.923866 (+ 378us) client_negotiation.cc:769] Sending connection context
0805 22:55:07.924122 (+ 256us) client_negotiation.cc:240] Negotiation successful
0805 22:55:07.924636 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":273,"threads_started":1}
I20260805 22:55:07.927629 3810 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43163
I20260805 22:55:07.927970 3810 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:07.928836 3810 heartbeater.cc:511] Master 127.20.34.126:43163 requested a full tablet report, sending...
I20260805 22:55:07.930677 3333 ts_manager.cc:194] Registered new tserver with Master: 3559ed86d49c4dc788fc05e73a51db4e (127.20.34.66:43195)
I20260805 22:55:07.931635 3333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:51723
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:55:07.984261 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43163
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:55:08.338569 3608 heartbeater.cc:503] Master 127.20.34.126:43163 was elected leader, sending a full tablet report...
W20260805 22:55:08.351986 3818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:08.352397 3818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:08.352504 3818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:08.360422 3818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:08.360541 3818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:08.360666 3818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:55:08.371088 3818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:08.372524 3818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:08.373806 3818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:08.387351 3823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:08.387331 3825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:08.387382 3827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:08.388410 3818 server_base.cc:1034] running on GCE node
I20260805 22:55:08.389156 3818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:08.390177 3818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:08.391448 3818 hybrid_clock.cc:648] HybridClock initialized: now 1785970508391395 us; error 44 us; skew 500 ppm
I20260805 22:55:08.391798 3818 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:55:08 dist-test-slave-gmjp krb5kdc[3269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970508, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:55:08.395366 3818 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:55:08.397181 3818 webserver.cc:460] Webserver started at http://127.20.34.67:37221/ using document root <none> and password file <none>
I20260805 22:55:08.397965 3818 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:08.398123 3818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:08.398483 3818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:55:08.401763 3818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "a7bebe69179f4156baf25b8a1889e868"
format_stamp: "Formatted at 2026-08-05 22:55:08 on dist-test-slave-gmjp"
server_key: "60e78869d8c0e15dc5b1d71bce6255f8"
server_key_iv: "2610377905758708f870fe224166f6f9"
server_key_version: "encryptionkey@0"
I20260805 22:55:08.402607 3818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "a7bebe69179f4156baf25b8a1889e868"
format_stamp: "Formatted at 2026-08-05 22:55:08 on dist-test-slave-gmjp"
server_key: "60e78869d8c0e15dc5b1d71bce6255f8"
server_key_iv: "2610377905758708f870fe224166f6f9"
server_key_version: "encryptionkey@0"
I20260805 22:55:08.408622 3818 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 22:55:08.412752 3834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:08.414410 3818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:55:08.414644 3818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "a7bebe69179f4156baf25b8a1889e868"
format_stamp: "Formatted at 2026-08-05 22:55:08 on dist-test-slave-gmjp"
server_key: "60e78869d8c0e15dc5b1d71bce6255f8"
server_key_iv: "2610377905758708f870fe224166f6f9"
server_key_version: "encryptionkey@0"
I20260805 22:55:08.414904 3818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:08.443292 3818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:08.447966 3818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:08.448348 3818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:08.449431 3818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:55:08.450980 3818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:55:08.451097 3818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:08.451256 3818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:55:08.451332 3818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:08.487368 3818 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:39031
I20260805 22:55:08.487433 4015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:39031 every 8 connection(s)
I20260805 22:55:08.488873 3818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:55:08.489478 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 3818
I20260805 22:55:08.489735 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:55:08.490365 20617 external_mini_cluster.cc:1428] Setting key 4acda243f2eacb77ef9bfd31e4487fd2
Aug 05 22:55:08 dist-test-slave-gmjp krb5kdc[3269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970508, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:55:08.511255 4019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.491878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:60127 (local address 127.20.34.126:43163)
0805 22:55:08.492475 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.492482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.493706 (+ 1224us) server_negotiation.cc:407] Connection header received
0805 22:55:08.495780 (+ 2074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.495785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.495885 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.496012 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:08.497656 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.498486 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.500098 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.500568 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.500709 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.504612 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:08.504619 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:08.504624 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:08.504671 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:08.507827 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:08.508783 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:08.508788 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:08.508791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:08.508933 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:08.509457 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:08.509461 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:08.509463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:08.509785 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:08.509915 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.510744 (+ 829us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.510950 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":305,"threads_started":1}
I20260805 22:55:08.512450 4020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.492694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43163 (local address 127.20.34.67:60127)
0805 22:55:08.493533 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:08.493580 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:08.495493 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:08.496326 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:08.496336 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:08.496871 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:55:08.497475 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.497493 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.498666 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.498670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.499936 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.499948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.500830 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.500837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.501088 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.501773 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:55:08.501797 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:55:08.504330 (+ 2533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:55:08.507998 (+ 3668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:55:08.508012 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:55:08.508032 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:55:08.508630 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:55:08.509089 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:55:08.509093 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:55:08.509096 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:55:08.509330 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:55:08.509928 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:55:08.509935 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:55:08.510329 (+ 394us) client_negotiation.cc:769] Sending connection context
0805 22:55:08.510592 (+ 263us) client_negotiation.cc:240] Negotiation successful
0805 22:55:08.511072 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":379,"threads_started":1}
I20260805 22:55:08.514148 4017 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43163
I20260805 22:55:08.514537 4017 heartbeater.cc:464] Registering TS with master...
I20260805 22:55:08.515362 4017 heartbeater.cc:511] Master 127.20.34.126:43163 requested a full tablet report, sending...
I20260805 22:55:08.516987 3333 ts_manager.cc:194] Registered new tserver with Master: a7bebe69179f4156baf25b8a1889e868 (127.20.34.67:39031)
I20260805 22:55:08.518113 3333 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:60127
I20260805 22:55:08.519990 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:55:08.538305 4019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.525019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58352 (local address 127.20.34.126:43163)
0805 22:55:08.525236 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.525241 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.525732 (+ 491us) server_negotiation.cc:407] Connection header received
0805 22:55:08.525882 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.525886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.525958 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.526052 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:08.527595 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.528478 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.529894 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.530443 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.530586 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.533101 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:08.533106 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:08.533109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:08.533144 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:08.535630 (+ 2486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:08.536434 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:08.536440 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:08.536444 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:08.536604 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:08.536972 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:08.536975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:08.536977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:08.537320 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:08.537504 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.537852 (+ 348us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.538036 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:55:08.543407 3333 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:55:08.550891 3333 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:55:08.597199 4036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.565043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:39031 (local address 127.0.0.1:46362)
0805 22:55:08.578273 (+ 13230us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:08.578355 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:08.578592 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:08.589087 (+ 10495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:08.589091 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:08.589119 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:55:08.589632 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.589651 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.591649 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.591655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.594019 (+ 2364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.594032 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.595913 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.595919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.596143 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.596250 (+ 107us) client_negotiation.cc:769] Sending connection context
0805 22:55:08.596410 (+ 160us) client_negotiation.cc:240] Negotiation successful
0805 22:55:08.596636 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12823,"mutex_wait_us":78,"thread_start_us":22039,"threads_started":1}
I20260805 22:55:08.597311 4040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.565462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58466 (local address 127.20.34.66:43195)
0805 22:55:08.587133 (+ 21671us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.587147 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.587188 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:55:08.587311 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.587328 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.587641 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.587875 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:55:08.589226 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.591813 (+ 2587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.594612 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.596094 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.596308 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.596522 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.596779 (+ 257us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.596987 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21402,"thread_start_us":21265,"threads_started":1}
I20260805 22:55:08.598067 4039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.565112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46362 (local address 127.20.34.67:39031)
0805 22:55:08.588613 (+ 23501us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.588619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.588646 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:55:08.588725 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.588729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.588881 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.589095 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:55:08.589874 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.591482 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.594197 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.595663 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.595818 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.596089 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.597486 (+ 1397us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.597691 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23348,"thread_start_us":23082,"threads_started":1}
I20260805 22:55:08.598340 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.587419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34031 (local address 127.0.0.1:60836)
0805 22:55:08.589888 (+ 2469us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:08.589904 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:08.590041 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:08.590958 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:08.590962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:08.590992 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:55:08.591265 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.591272 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.593180 (+ 1908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.593185 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.595101 (+ 1916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.595113 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.597157 (+ 2044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.597164 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.597691 (+ 527us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.597725 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:55:08.597839 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 22:55:08.597972 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2342,"thread_start_us":2122,"threads_started":1}
I20260805 22:55:08.598410 4041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.580272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60836 (local address 127.20.34.65:34031)
0805 22:55:08.587941 (+ 7669us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.587953 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.590010 (+ 2057us) server_negotiation.cc:407] Connection header received
0805 22:55:08.590265 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.590272 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.590472 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.590598 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:55:08.591461 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.592992 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.595270 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.596618 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.596761 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.596994 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.597908 (+ 914us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.598084 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7422,"thread_start_us":7296,"threads_started":1}
I20260805 22:55:08.599156 4037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.565117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:43195 (local address 127.0.0.1:58466)
0805 22:55:08.586268 (+ 21151us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:08.586297 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:08.586478 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:08.588297 (+ 1819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:08.588308 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:08.588376 (+ 68us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:55:08.588944 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.588962 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.591971 (+ 3009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.591977 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.594428 (+ 2451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.594444 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.596381 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.596388 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.596572 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.596607 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 22:55:08.596711 (+ 104us) client_negotiation.cc:240] Negotiation successful
0805 22:55:08.596854 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20932,"mutex_wait_us":3,"thread_start_us":13711,"threads_started":1}
I20260805 22:55:08.601982 3917 tablet_service.cc:1467] Processing CreateTablet for tablet 452012bdd76846bb8229b51ef486b7bf (DEFAULT_TABLE table=test-table [id=146f51f70b1e4b6e83d83c7560b1b837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:55:08.602260 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 452012bdd76846bb8229b51ef486b7bf (DEFAULT_TABLE table=test-table [id=146f51f70b1e4b6e83d83c7560b1b837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:55:08.602555 3705 tablet_service.cc:1467] Processing CreateTablet for tablet 452012bdd76846bb8229b51ef486b7bf (DEFAULT_TABLE table=test-table [id=146f51f70b1e4b6e83d83c7560b1b837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:55:08.603396 3917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 452012bdd76846bb8229b51ef486b7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:55:08.603749 3514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 452012bdd76846bb8229b51ef486b7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:55:08.603770 3705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 452012bdd76846bb8229b51ef486b7bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:55:08.621723 4046 tablet_bootstrap.cc:492] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Bootstrap starting.
I20260805 22:55:08.628895 4047 tablet_bootstrap.cc:492] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Bootstrap starting.
I20260805 22:55:08.629019 4043 tablet_bootstrap.cc:492] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Bootstrap starting.
I20260805 22:55:08.630314 4046 tablet_bootstrap.cc:654] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Neither blocks nor log segments found. Creating new log.
I20260805 22:55:08.631978 4046 log.cc:824] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Log is configured to *not* fsync() on all Append() calls
I20260805 22:55:08.633080 4043 tablet_bootstrap.cc:654] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Neither blocks nor log segments found. Creating new log.
I20260805 22:55:08.634467 4043 log.cc:824] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Log is configured to *not* fsync() on all Append() calls
I20260805 22:55:08.636226 4047 tablet_bootstrap.cc:654] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Neither blocks nor log segments found. Creating new log.
I20260805 22:55:08.637312 4047 log.cc:824] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Log is configured to *not* fsync() on all Append() calls
I20260805 22:55:08.638127 4043 tablet_bootstrap.cc:492] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: No bootstrap required, opened a new log
I20260805 22:55:08.638126 4046 tablet_bootstrap.cc:492] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: No bootstrap required, opened a new log
I20260805 22:55:08.638456 4043 ts_tablet_manager.cc:1397] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260805 22:55:08.638481 4046 ts_tablet_manager.cc:1397] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.000s
I20260805 22:55:08.640611 4047 tablet_bootstrap.cc:492] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: No bootstrap required, opened a new log
I20260805 22:55:08.640909 4047 ts_tablet_manager.cc:1397] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260805 22:55:08.650063 4047 raft_consensus.cc:348] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.650082 4046 raft_consensus.cc:348] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.650082 4043 raft_consensus.cc:348] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.650523 4047 raft_consensus.cc:374] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:55:08.650555 4046 raft_consensus.cc:374] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:55:08.650555 4043 raft_consensus.cc:374] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:55:08.650643 4047 raft_consensus.cc:729] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 253bb4ec96c64d68a6f20e822b698824, State: Initialized, Role: FOLLOWER
I20260805 22:55:08.650664 4043 raft_consensus.cc:729] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7bebe69179f4156baf25b8a1889e868, State: Initialized, Role: FOLLOWER
I20260805 22:55:08.650719 4046 raft_consensus.cc:729] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3559ed86d49c4dc788fc05e73a51db4e, State: Initialized, Role: FOLLOWER
I20260805 22:55:08.651409 4047 consensus_queue.cc:260] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.651507 4046 consensus_queue.cc:260] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.651507 4043 consensus_queue.cc:260] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.653468 4047 ts_tablet_manager.cc:1428] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
I20260805 22:55:08.657923 4043 ts_tablet_manager.cc:1428] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Time spent starting tablet: real 0.019s user 0.004s sys 0.014s
I20260805 22:55:08.658102 3810 heartbeater.cc:503] Master 127.20.34.126:43163 was elected leader, sending a full tablet report...
I20260805 22:55:08.658143 4017 heartbeater.cc:503] Master 127.20.34.126:43163 was elected leader, sending a full tablet report...
I20260805 22:55:08.660405 4046 ts_tablet_manager.cc:1428] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Time spent starting tablet: real 0.022s user 0.011s sys 0.011s
W20260805 22:55:08.740892 4018 tablet.cc:2369] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:55:08.794154 4054 raft_consensus.cc:482] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:55:08.794507 4054 raft_consensus.cc:504] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.796473 4054 leader_election.cc:288] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7bebe69179f4156baf25b8a1889e868 (127.20.34.67:39031), 3559ed86d49c4dc788fc05e73a51db4e (127.20.34.66:43195)
I20260805 22:55:08.803848 4040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.797028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:44481 (local address 127.20.34.66:43195)
0805 22:55:08.797256 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.797263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.798193 (+ 930us) server_negotiation.cc:407] Connection header received
0805 22:55:08.798456 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.798460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.798529 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.798653 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:55:08.799288 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.800020 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.802021 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.802855 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.803052 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.803133 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.803431 (+ 298us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.803566 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:55:08.803939 4039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.797130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:33607 (local address 127.20.34.67:39031)
0805 22:55:08.797340 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.797344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.798565 (+ 1221us) server_negotiation.cc:407] Connection header received
0805 22:55:08.798763 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.798767 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.798834 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.798937 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:55:08.799557 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.800370 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.802194 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.802984 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.803186 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.803264 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.803541 (+ 277us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.803674 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:55:08.804000 4059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.797081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:43195 (local address 127.20.34.65:44481)
0805 22:55:08.798022 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:08.798050 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:08.798270 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:08.798686 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:08.798691 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:08.798730 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:55:08.799099 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.799109 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.800199 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.800204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.801849 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.801863 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.803078 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.803085 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.803263 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.803288 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:55:08.803401 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 22:55:08.803539 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":48,"thread_start_us":478,"threads_started":1}
I20260805 22:55:08.804081 4061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.797081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:39031 (local address 127.20.34.65:33607)
0805 22:55:08.798433 (+ 1352us) negotiation.cc:107] Waiting for socket to connect
0805 22:55:08.798467 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0805 22:55:08.798611 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:55:08.798957 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:55:08.798961 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:55:08.798985 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:55:08.799385 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.799394 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.800513 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.800518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.802024 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:55:08.802038 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.803218 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.803224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:55:08.803381 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.803404 (+ 23us) client_negotiation.cc:769] Sending connection context
0805 22:55:08.803512 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:55:08.803641 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1210,"mutex_wait_us":31,"spinlock_wait_cycles":25472,"thread_start_us":930,"threads_started":1}
I20260805 22:55:08.805264 3733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "452012bdd76846bb8229b51ef486b7bf" candidate_uuid: "253bb4ec96c64d68a6f20e822b698824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3559ed86d49c4dc788fc05e73a51db4e" is_pre_election: true
I20260805 22:55:08.805356 3948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "452012bdd76846bb8229b51ef486b7bf" candidate_uuid: "253bb4ec96c64d68a6f20e822b698824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7bebe69179f4156baf25b8a1889e868" is_pre_election: true
I20260805 22:55:08.805866 3733 raft_consensus.cc:2454] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 253bb4ec96c64d68a6f20e822b698824 in term 0.
W20260805 22:55:08.805899 3609 tablet.cc:2369] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:55:08.805981 3948 raft_consensus.cc:2454] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 253bb4ec96c64d68a6f20e822b698824 in term 0.
I20260805 22:55:08.806716 3448 leader_election.cc:302] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 253bb4ec96c64d68a6f20e822b698824, 3559ed86d49c4dc788fc05e73a51db4e; no voters:
I20260805 22:55:08.807222 4054 raft_consensus.cc:2781] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:55:08.807341 4054 raft_consensus.cc:482] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:55:08.807472 4054 raft_consensus.cc:3037] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:55:08.809906 4054 raft_consensus.cc:504] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.810590 4054 leader_election.cc:288] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [CANDIDATE]: Term 1 election: Requested vote from peers a7bebe69179f4156baf25b8a1889e868 (127.20.34.67:39031), 3559ed86d49c4dc788fc05e73a51db4e (127.20.34.66:43195)
I20260805 22:55:08.811148 3733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "452012bdd76846bb8229b51ef486b7bf" candidate_uuid: "253bb4ec96c64d68a6f20e822b698824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3559ed86d49c4dc788fc05e73a51db4e"
I20260805 22:55:08.811147 3948 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "452012bdd76846bb8229b51ef486b7bf" candidate_uuid: "253bb4ec96c64d68a6f20e822b698824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7bebe69179f4156baf25b8a1889e868"
I20260805 22:55:08.811393 3948 raft_consensus.cc:3037] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:55:08.811393 3733 raft_consensus.cc:3037] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:55:08.814867 3948 raft_consensus.cc:2454] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 253bb4ec96c64d68a6f20e822b698824 in term 1.
I20260805 22:55:08.814869 3733 raft_consensus.cc:2454] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 253bb4ec96c64d68a6f20e822b698824 in term 1.
I20260805 22:55:08.815533 3450 leader_election.cc:302] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 253bb4ec96c64d68a6f20e822b698824, 3559ed86d49c4dc788fc05e73a51db4e, a7bebe69179f4156baf25b8a1889e868; no voters:
I20260805 22:55:08.815979 4054 raft_consensus.cc:2781] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:55:08.816655 4054 raft_consensus.cc:686] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 1 LEADER]: Becoming Leader. State: Replica: 253bb4ec96c64d68a6f20e822b698824, State: Running, Role: LEADER
I20260805 22:55:08.817243 4054 consensus_queue.cc:237] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } }
I20260805 22:55:08.822574 3333 catalog_manager.cc:5495] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 253bb4ec96c64d68a6f20e822b698824 (127.20.34.65). New cstate: current_term: 1 leader_uuid: "253bb4ec96c64d68a6f20e822b698824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "253bb4ec96c64d68a6f20e822b698824" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34031 } health_report { overall_health: HEALTHY } } }
I20260805 22:55:08.878597 4041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.872626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60846 (local address 127.20.34.65:34031)
0805 22:55:08.872861 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.872868 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.873008 (+ 140us) server_negotiation.cc:407] Connection header received
0805 22:55:08.873278 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.873282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.873380 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.873549 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:55:08.873967 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.874752 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.876185 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.876619 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.876764 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.877369 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:55:08.877925 (+ 556us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:55:08.878105 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.878189 (+ 84us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.878280 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:55:08.887940 3733 raft_consensus.cc:1261] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 1 FOLLOWER]: Refusing update from remote peer 253bb4ec96c64d68a6f20e822b698824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:55:08.887940 3948 raft_consensus.cc:1261] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 1 FOLLOWER]: Refusing update from remote peer 253bb4ec96c64d68a6f20e822b698824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:55:08.889267 4062 consensus_queue.cc:1035] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3559ed86d49c4dc788fc05e73a51db4e" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:55:08.889674 4054 consensus_queue.cc:1035] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7bebe69179f4156baf25b8a1889e868" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 39031 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:55:08.901774 3812 tablet.cc:2369] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:55:08.902964 4069 mvcc.cc:205] Tried to move back new op lower bound from 7315335204393836544 to 7315335204119715840. Current Snapshot: MvccSnapshot[applied={T|T < 7315335204393836544}]
I20260805 22:55:08.906468 4067 mvcc.cc:205] Tried to move back new op lower bound from 7315335204393836544 to 7315335204119715840. Current Snapshot: MvccSnapshot[applied={T|T < 7315335204393836544}]
I20260805 22:55:08.949465 3333 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:55:08.949863 3333 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:55:08.954674 3333 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5ac40fee049f45a5aca59ff792964b55: Sending DeleteTablet for 3 replicas of tablet 452012bdd76846bb8229b51ef486b7bf
I20260805 22:55:08.956274 3917 tablet_service.cc:1514] Processing DeleteTablet for tablet 452012bdd76846bb8229b51ef486b7bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:55:08 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:46362
I20260805 22:55:08.956475 3705 tablet_service.cc:1514] Processing DeleteTablet for tablet 452012bdd76846bb8229b51ef486b7bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:55:08 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:58466
I20260805 22:55:08.956696 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 452012bdd76846bb8229b51ef486b7bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:55:08 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:60836
I20260805 22:55:08.957124 3916 tablet_service.cc:1514] Processing DeleteTablet for tablet 452012bdd76846bb8229b51ef486b7bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:55:08 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:46362
I20260805 22:55:08.959100 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 3427
I20260805 22:55:08.973116 4083 tablet_replica.cc:330] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: stopping tablet replica
I20260805 22:55:08.973821 4083 raft_consensus.cc:2229] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:55:08.974557 4083 raft_consensus.cc:2258] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:55:08.978103 4083 ts_tablet_manager.cc:1905] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:55:08.978554 4084 tablet_replica.cc:330] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: stopping tablet replica
I20260805 22:55:08.979177 4084 raft_consensus.cc:2229] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:55:08.979853 4084 raft_consensus.cc:2258] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:55:08.983637 4085 tablet_replica.cc:330] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: stopping tablet replica
I20260805 22:55:08.984194 4085 raft_consensus.cc:2229] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:55:08.984956 4085 raft_consensus.cc:2258] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:55:08.982739 4084 ts_tablet_manager.cc:1905] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:55:08.986063 4083 ts_tablet_manager.cc:1918] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:55:08.986261 4083 log.cc:1196] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/452012bdd76846bb8229b51ef486b7bf
I20260805 22:55:08.986908 4083 ts_tablet_manager.cc:1939] T 452012bdd76846bb8229b51ef486b7bf P a7bebe69179f4156baf25b8a1889e868: Deleting consensus metadata
Aug 05 22:55:08 dist-test-slave-gmjp krb5kdc[3269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:55:08.989141 3316 catalog_manager.cc:4841] TS a7bebe69179f4156baf25b8a1889e868 (127.20.34.67:39031): tablet 452012bdd76846bb8229b51ef486b7bf (table test-table [id=146f51f70b1e4b6e83d83c7560b1b837]) successfully deleted
W20260805 22:55:08.990336 3316 catalog_manager.cc:4808] TS a7bebe69179f4156baf25b8a1889e868 (127.20.34.67:39031): delete failed for tablet 452012bdd76846bb8229b51ef486b7bf because the tablet was not found. No further retry: Not found: Tablet not found: 452012bdd76846bb8229b51ef486b7bf
I20260805 22:55:08.990619 4085 ts_tablet_manager.cc:1905] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:55:08.998350 4084 ts_tablet_manager.cc:1918] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:55:08.998693 4084 log.cc:1196] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/452012bdd76846bb8229b51ef486b7bf
I20260805 22:55:08.999171 4085 ts_tablet_manager.cc:1918] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:55:08.999370 4085 log.cc:1196] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/452012bdd76846bb8229b51ef486b7bf
I20260805 22:55:08.999421 4084 ts_tablet_manager.cc:1939] T 452012bdd76846bb8229b51ef486b7bf P 3559ed86d49c4dc788fc05e73a51db4e: Deleting consensus metadata
I20260805 22:55:08.999838 4041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:08.960560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60854 (local address 127.20.34.65:34031)
0805 22:55:08.960824 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:08.960839 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:08.967008 (+ 6169us) server_negotiation.cc:407] Connection header received
0805 22:55:08.968350 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:08.968361 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:08.968479 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:08.968589 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:08.975596 (+ 7007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.977704 (+ 2108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.983287 (+ 5583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:08.984072 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:08.984309 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:08.990419 (+ 6110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:08.990448 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:08.990467 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:08.990526 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:08.995366 (+ 4840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:08.996560 (+ 1194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:08.996572 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:08.996575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:08.996839 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:08.997421 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:08.997427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:08.997430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:08.997990 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:08.998326 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:08.999036 (+ 710us) server_negotiation.cc:299] Negotiation successful
0805 22:55:08.999344 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 22:55:09.000099 4085 ts_tablet_manager.cc:1939] T 452012bdd76846bb8229b51ef486b7bf P 253bb4ec96c64d68a6f20e822b698824: Deleting consensus metadata
I20260805 22:55:09.001477 3599 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:09.001999 3315 catalog_manager.cc:4841] TS 3559ed86d49c4dc788fc05e73a51db4e (127.20.34.66:43195): tablet 452012bdd76846bb8229b51ef486b7bf (table test-table [id=146f51f70b1e4b6e83d83c7560b1b837]) successfully deleted
I20260805 22:55:09.106673 3315 catalog_manager.cc:4841] TS 253bb4ec96c64d68a6f20e822b698824 (127.20.34.65:34031): tablet 452012bdd76846bb8229b51ef486b7bf (table test-table [id=146f51f70b1e4b6e83d83c7560b1b837]) successfully deleted
I20260805 22:55:09.107260 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 3427
I20260805 22:55:09.135488 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 3614
Aug 05 22:55:09 dist-test-slave-gmjp krb5kdc[3269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:55:09.151734 4040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:09.136434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58468 (local address 127.20.34.66:43195)
0805 22:55:09.136663 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:09.136669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:09.136689 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:55:09.136863 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:09.136869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:09.136957 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:09.137073 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:09.138385 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:09.139205 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:09.140615 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:09.141044 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:09.141187 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:09.145625 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:09.145641 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:09.145660 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:09.145706 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:09.148659 (+ 2953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:09.149410 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:09.149418 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:09.149421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:09.149563 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:09.149981 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:09.149985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:09.149987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:09.150415 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:09.150760 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:09.151107 (+ 347us) server_negotiation.cc:299] Negotiation successful
0805 22:55:09.151356 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 22:55:09.152561 3802 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:09.248797 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 3614
I20260805 22:55:09.273494 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 3818
Aug 05 22:55:09 dist-test-slave-gmjp krb5kdc[3269](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:55:09.290107 4039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:09.274463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.20.34.67:39031)
0805 22:55:09.274666 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:09.274674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:09.274699 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:55:09.274950 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:09.274955 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:09.275038 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:09.275164 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:09.276707 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:09.277459 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:09.278784 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:09.279192 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:09.279339 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:09.284268 (+ 4929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:09.284287 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:09.284305 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:09.284348 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:09.287049 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:09.287818 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:09.287825 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:09.287828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:09.287982 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:09.288459 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:09.288464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:09.288469 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:09.288855 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:09.289161 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:09.289512 (+ 351us) server_negotiation.cc:299] Negotiation successful
0805 22:55:09.289745 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:55:09.290779 4010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:09.382830 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 3818
I20260805 22:55:09.407938 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 3290
I20260805 22:55:09.409384 3380 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:55:09.525465 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 3290
2026-08-05T22:55:09Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5091 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:55:09 dist-test-slave-gmjp krb5kdc[4095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:55:09 dist-test-slave-gmjp krb5kdc[4095](info): set up 2 sockets
Aug 05 22:55:09 dist-test-slave-gmjp krb5kdc[4095](info): commencing operation
krb5kdc: starting...
W20260805 22:55:10.876652 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.006s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:55:11 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:55:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:55:11Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.34.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.34.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/rangeradmin_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/rangeradmin_127.20.34.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.34.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.34.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/rangerlookup_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/rangerlookup_127.20.34.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.34.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.34.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/HTTP_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/HTTP_127.20.34.84@KRBTEST.COM.keytab.
I20260805 22:55:11.363682 20617 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskj1qIwm/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/postgres -l logfile start
2026-08-05 22:55:13.959 UTC [4135] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-05 22:55:13.959 UTC [4135] LOG: listening on IPv4 address "127.20.34.84", port 55787
2026-08-05 22:55:13.963 UTC [4135] LOG: listening on Unix socket "/tmp/.s.PGSQL.55787"
2026-08-05 22:55:13.990 UTC [4138] LOG: database system was shut down at 2026-08-05 22:55:12 UTC
2026-08-05 22:55:13.994 UTC [4135] LOG: database system is ready to accept connections
I20260805 22:55:15.176035 20617 mini_postgres.cc:96] Postgres bound to 55787
2026-08-05 22:55:15.206 UTC [4158] FATAL: database "slave" does not exist
127.20.34.84:55787 - accepting connections
I20260805 22:55:15.207203 20617 mini_ranger.cc:161] Starting Ranger...
I20260805 22:55:15.244655 20617 mini_ranger.cc:84] Created miniranger Postgres user
I20260805 22:55:15.770597 20617 mini_ranger.cc:87] Created ranger Postgres database
I20260805 22:55:15.770761 20617 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-admin
2026-08-05 22:55:16,104 [I] DB FLAVOR :POSTGRES
2026-08-05 22:55:16,105 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:55:16,105 [I] Checking connection..
2026-08-05 22:55:16,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-05 22:55:16,415 [I] Checking connection passed.
2026-08-05 22:55:16,415 [I] --------- Verifying version history table ---------
2026-08-05 22:55:16,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:55:16,694 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:55:16,694 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:55:16,942 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:55:16,943 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-05 22:55:16,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-05 22:55:17.210 UTC [4255] WARNING: there is no transaction in progress
2026-08-05 22:55:17,219 [I] create_dbversion_catalog.sql file imported successfully
2026-08-05 22:55:17,220 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:55:17,494 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-05 22:55:17,494 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:55:17,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-05 22:55:17,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-05 22:55:18,031 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gmjp.c.gcp-upstream.internal','N') ;"
2026-08-05 22:55:18,278 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:55:18,544 [I] Table x_portal_user does not exist in database ranger
2026-08-05 22:55:18,545 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:55:18,797 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-05 22:55:18,798 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:55:19,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:55:19,344 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-05 22:55:19,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-05 22:55:20.435 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.452 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.471 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.488 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.509 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.532 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.592 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.600 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.617 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.628 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.640 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.656 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.667 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.674 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.682 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:20.691 UTC [4416] WARNING: there is no transaction in progress
2026-08-05 22:55:21,421 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-05 22:55:21,422 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-05 22:55:21,696 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-05 22:55:21,697 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:55:21,975 [I] Table x_portal_user already exists in database 'ranger'
2026-08-05 22:55:21,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:55:22,256 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-05 22:55:22,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:55:22,528 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:55:22,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gmjp.c.gcp-upstream.internal';"
2026-08-05 22:55:23,058 [I] CORE_DB_SCHEMA import status has been updated
2026-08-05 22:55:23,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-05 22:55:23,325 [I] DB_PATCHES have already been applied
I20260805 22:55:23.332333 20617 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-admin:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskj1qIwm/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260805 22:55:23.332435 20617 mini_ranger.cc:193] Using host: 127.20.34.84
I20260805 22:55:23.357740 20617 mini_ranger.cc:227] Ranger admin URL: http://127.20.34.84:58493
Aug 05, 2026 10:55:23 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:55:23 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:55:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-admin/ews/webapp
Aug 05, 2026 10:55:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 05, 2026 10:55:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 05, 2026 10:55:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-admin/ews/webapp].
Aug 05, 2026 10:55:24 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260805 22:55:24.732236 20617 mini_ranger.cc:160] Time spent starting Ranger: real 9.525s user 0.010s sys 0.073s
Aug 05, 2026 10:55:46 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 05, 2026 10:55:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 05, 2026 10:55:46 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 05, 2026 10:55:46 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 05, 2026 10:55:47 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260805 22:55:48.274041 20617 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.34.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.34.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/rangerkms_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/rangerkms_127.20.34.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.34.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.34.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.34.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/HTTP_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.34.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/HTTP_127.20.34.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 05 22:55:48 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970548, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260805 22:55:48.546658 20617 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260805 22:55:48.580565 20617 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260805 22:55:49.464819 20617 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260805 22:55:49.465018 20617 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms
I20260805 22:55:49.465137 20617 mini_ranger_kms.cc:227] Using postgres at 127.20.34.84:55787
2026-08-05 22:55:50,326 [I] DB FLAVOR :POSTGRES
2026-08-05 22:55:50,326 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:55:50,326 [I] Checking connection
2026-08-05 22:55:50,326 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-05 22:55:50,591 [I] connection success
2026-08-05 22:55:50,591 [I] --------- Verifying Ranger DB tables ---------
2026-08-05 22:55:50,591 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-05 22:55:50,591 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-05 22:55:50,843 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-05 22:55:50,843 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:55:50,844 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-05 22:55:50,844 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:55787/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-05 22:55:51,126 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260805 22:55:51.697227 20617 mini_ranger_kms.cc:310] Created kms service
I20260805 22:55:51.931692 20617 mini_ranger_kms.cc:326] Created kudu user
I20260805 22:55:51.978315 20617 mini_ranger_kms.cc:343] Created rangerkms user
Aug 05 22:55:51 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970548, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:55:52.426606 20617 mini_ranger_kms.cc:384] Added ranger policy
I20260805 22:55:52.428067 20617 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms:/tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260805 22:55:52.428186 20617 mini_ranger_kms.cc:240] Using host: 127.20.34.84
I20260805 22:55:52.465905 20617 mini_ranger_kms.cc:276] Ranger KMS PID: 4690
I20260805 22:55:52.466130 20617 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.34.84:49339
Aug 05, 2026 10:55:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:55:53 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:55:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 05, 2026 10:55:53 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 05, 2026 10:55:54 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-kms/ews/webapp].
Aug 05, 2026 10:55:54 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 05 22:55:54 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970554, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.34.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:55:55.299630 20617 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.753s user 0.153s sys 0.486s
I20260805 22:55:55.300051 20617 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260805 22:55:55.300359 20617 mini_ranger_kms.cc:401] 127.20.34.84:49339/kms/v1/keys
Aug 05 22:55:55 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970554, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.34.84@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
Aug 05 22:55:55 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970554, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.34.84@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
Aug 05 22:55:58 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:55:58.160470 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:37217
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:37217
--ranger_config_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:49339/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:55:58.549149 4768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:55:58.549467 4768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:55:58.549614 4768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:55:58.557194 4768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:55:58.557325 4768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:55:58.557415 4768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:55:58.557515 4768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:55:58.557603 4768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:55:58.568545 4768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.34.84:49339/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:37217
--ranger_config_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:37217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:55:58.570053 4768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:55:58.571520 4768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:55:58.586337 4775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:55:58.586570 4781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:58.586993 4768 server_base.cc:1034] running on GCE node
W20260805 22:55:58.586203 4777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:55:58.588086 4768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:55:58.589763 4768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:55:58.591043 4768 hybrid_clock.cc:648] HybridClock initialized: now 1785970558590989 us; error 45 us; skew 500 ppm
I20260805 22:55:58.591557 4768 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:55:58 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970558, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:55:58.602360 4768 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:55:58.604485 4768 webserver.cc:460] Webserver started at http://127.20.34.126:33711/ using document root <none> and password file <none>
I20260805 22:55:58.605290 4768 fs_manager.cc:359] Metadata directory not provided
I20260805 22:55:58.605464 4768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:55:58.605852 4768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:55:58 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970558, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:55:58.663623 4768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "f11c25ea11214b418ea83a607a4399af"
format_stamp: "Formatted at 2026-08-05 22:55:58 on dist-test-slave-gmjp"
server_key: "304fbbd5facd8bf676b12663e3e3c6ce"
server_key_iv: "66e47c6ba4844762d55ea818a67261bb"
server_key_version: "kuduclusterkey@0"
I20260805 22:55:58.664685 4768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "f11c25ea11214b418ea83a607a4399af"
format_stamp: "Formatted at 2026-08-05 22:55:58 on dist-test-slave-gmjp"
server_key: "304fbbd5facd8bf676b12663e3e3c6ce"
server_key_iv: "66e47c6ba4844762d55ea818a67261bb"
server_key_version: "kuduclusterkey@0"
I20260805 22:55:58.671025 4768 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260805 22:55:58.692224 4791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:55:58.694128 4768 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:55:58.694348 4768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "f11c25ea11214b418ea83a607a4399af"
format_stamp: "Formatted at 2026-08-05 22:55:58 on dist-test-slave-gmjp"
server_key: "304fbbd5facd8bf676b12663e3e3c6ce"
server_key_iv: "66e47c6ba4844762d55ea818a67261bb"
server_key_version: "kuduclusterkey@0"
I20260805 22:55:58.694633 4768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:55:58.714668 4768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:55:58.719962 4768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:55:58.720352 4768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:55:58.743762 4768 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:37217
I20260805 22:55:58.743762 4860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:37217 every 8 connection(s)
I20260805 22:55:58.745663 4768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:55:58.750102 4861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:55:58.752424 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 4768
I20260805 22:55:58.752669 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:55:58.753564 20617 external_mini_cluster.cc:1428] Setting key 1a6591ffd0e7a1dc5c9b0c49c9c9ece4
I20260805 22:55:58.769898 4861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af: Bootstrap starting.
I20260805 22:55:58.773834 4861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af: Neither blocks nor log segments found. Creating new log.
I20260805 22:55:58.775470 4861 log.cc:824] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af: Log is configured to *not* fsync() on all Append() calls
I20260805 22:55:58.779167 4861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af: No bootstrap required, opened a new log
Aug 05 22:55:58 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:55:58.789414 4861 raft_consensus.cc:348] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f11c25ea11214b418ea83a607a4399af" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37217 } }
I20260805 22:55:58.789918 4861 raft_consensus.cc:374] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:55:58.790059 4861 raft_consensus.cc:729] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11c25ea11214b418ea83a607a4399af, State: Initialized, Role: FOLLOWER
I20260805 22:55:58.790774 4861 consensus_queue.cc:260] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f11c25ea11214b418ea83a607a4399af" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37217 } }
I20260805 22:55:58.791059 4861 raft_consensus.cc:388] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:55:58.791218 4861 raft_consensus.cc:482] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:55:58.791404 4861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:55:58.794417 4861 raft_consensus.cc:504] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f11c25ea11214b418ea83a607a4399af" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37217 } }
I20260805 22:55:58.795127 4861 leader_election.cc:302] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f11c25ea11214b418ea83a607a4399af; no voters:
I20260805 22:55:58.795816 4861 leader_election.cc:288] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:55:58.795979 4867 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:55:58.796066 4864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:55:58.756089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32798 (local address 127.20.34.126:37217)
0805 22:55:58.768832 (+ 12743us) server_negotiation.cc:206] Beginning negotiation
0805 22:55:58.768857 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0805 22:55:58.769351 (+ 494us) server_negotiation.cc:407] Connection header received
0805 22:55:58.772439 (+ 3088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:55:58.772480 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:55:58.773102 (+ 622us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:55:58.773600 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:55:58.775488 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:58.777728 (+ 2240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:58.779668 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:55:58.780779 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:55:58.781004 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:55:58.786288 (+ 5284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:55:58.786303 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:55:58.786328 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:55:58.786392 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:55:58.790825 (+ 4433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:58.791836 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:58.791846 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:58.791856 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:58.792067 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:55:58.792601 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:55:58.792608 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:55:58.792611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:55:58.793457 (+ 846us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:55:58.793804 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0805 22:55:58.794208 (+ 404us) server_negotiation.cc:299] Negotiation successful
0805 22:55:58.794615 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12418,"thread_start_us":12122,"threads_started":1}
I20260805 22:55:58.798717 4867 raft_consensus.cc:686] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [term 1 LEADER]: Becoming Leader. State: Replica: f11c25ea11214b418ea83a607a4399af, State: Running, Role: LEADER
I20260805 22:55:58.799458 4867 consensus_queue.cc:237] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f11c25ea11214b418ea83a607a4399af" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37217 } }
I20260805 22:55:58.799965 4861 sys_catalog.cc:564] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:55:58.803779 4874 sys_catalog.cc:455] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f11c25ea11214b418ea83a607a4399af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f11c25ea11214b418ea83a607a4399af" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37217 } } }
I20260805 22:55:58.804092 4876 sys_catalog.cc:455] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [sys.catalog]: SysCatalogTable state changed. Reason: New leader f11c25ea11214b418ea83a607a4399af. Latest consensus state: current_term: 1 leader_uuid: "f11c25ea11214b418ea83a607a4399af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f11c25ea11214b418ea83a607a4399af" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37217 } } }
I20260805 22:55:58.804382 4874 sys_catalog.cc:458] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [sys.catalog]: This master's current role is: LEADER
I20260805 22:55:58.804437 4876 sys_catalog.cc:458] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af [sys.catalog]: This master's current role is: LEADER
I20260805 22:55:58.806463 4890 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:55:58.811503 4890 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:55:58.812492 4861 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 22:55:58.833182 4890 catalog_manager.cc:1347] Generated new cluster ID: 72e12e37e48c4db38f4f50f3d0b56505
I20260805 22:55:58.833513 4890 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:55:58.856622 4890 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:55:58.859216 4890 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:55:58.868583 4890 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af: Generated new TSK 0
I20260805 22:55:58.869896 4890 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:55:59.670913 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:49339/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:37217
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:56:00 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970560, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260805 22:56:00.187791 4935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:00.188308 4935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:00.188488 4935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:00.200630 4935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:00.200814 4935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:00.201027 4935 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:56:00.217666 4935 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.34.84:49339/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:37217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:00.219625 4935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:00.221517 4935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:00.241089 4951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:00.242437 4952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:00.250473 4956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:00.251334 4935 server_base.cc:1034] running on GCE node
I20260805 22:56:00.252238 4935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:00.253677 4935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:00.254994 4935 hybrid_clock.cc:648] HybridClock initialized: now 1785970560254898 us; error 62 us; skew 500 ppm
I20260805 22:56:00.255782 4935 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:00 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970560, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:00.261425 4935 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:56:00.265308 4935 webserver.cc:460] Webserver started at http://127.20.34.65:37901/ using document root <none> and password file <none>
I20260805 22:56:00.266378 4935 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:00.266571 4935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:56:00.267133 4935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:56:00 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970560, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:00.310200 4935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "e7e2cf9652bf42809312ed7c1e709c19"
format_stamp: "Formatted at 2026-08-05 22:56:00 on dist-test-slave-gmjp"
server_key: "51070cfa03ebe39382e8f2636b37e8f8"
server_key_iv: "f2a2e4859771b391b48b1e1e7bc64fcc"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:00.313475 4935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "e7e2cf9652bf42809312ed7c1e709c19"
format_stamp: "Formatted at 2026-08-05 22:56:00 on dist-test-slave-gmjp"
server_key: "51070cfa03ebe39382e8f2636b37e8f8"
server_key_iv: "f2a2e4859771b391b48b1e1e7bc64fcc"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:00.322194 4935 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.003s
I20260805 22:56:00.341766 4970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:00.343520 4935 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260805 22:56:00.343758 4935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "e7e2cf9652bf42809312ed7c1e709c19"
format_stamp: "Formatted at 2026-08-05 22:56:00 on dist-test-slave-gmjp"
server_key: "51070cfa03ebe39382e8f2636b37e8f8"
server_key_iv: "f2a2e4859771b391b48b1e1e7bc64fcc"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:00.344043 4935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:00.369333 4935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:00.375355 4935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:00.375855 4935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:00.388722 4935 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:00.397449 4935 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:00.397660 4935 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 22:56:00.397886 4935 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:00.398017 4935 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:00.498302 4935 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:42059
I20260805 22:56:00.498387 5154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:42059 every 8 connection(s)
I20260805 22:56:00.500216 4935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:56:00.504145 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 4935
I20260805 22:56:00.504477 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:56:00.505553 20617 external_mini_cluster.cc:1428] Setting key 7b2d26d029c1c9b9a8c2d849411dc2d2
Aug 05 22:56:00 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970560, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:00.545680 5158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:00.505425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:37217 (local address 127.20.34.65:56377)
0805 22:56:00.506450 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:00.506519 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:00.508967 (+ 2448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:00.525009 (+ 16042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:00.525028 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:00.525828 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:00.526805 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:00.526845 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:00.528857 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:00.528863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:00.530999 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:00.531018 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:00.532195 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:00.532204 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:00.532537 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:00.533414 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:00.533448 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:00.536255 (+ 2807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:00.540620 (+ 4365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:00.540631 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:00.540652 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:00.541302 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:00.541836 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:00.541840 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:00.541843 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:00.542136 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:00.542803 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:00.542812 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:00.543312 (+ 500us) client_negotiation.cc:769] Sending connection context
0805 22:56:00.543628 (+ 316us) client_negotiation.cc:240] Negotiation successful
0805 22:56:00.544228 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"thread_start_us":764,"threads_started":1}
I20260805 22:56:00.547716 5161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:00.506043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:56377 (local address 127.20.34.126:37217)
0805 22:56:00.524069 (+ 18026us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:00.524076 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:00.524108 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:56:00.524242 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:00.524248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:00.524368 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:00.527092 (+ 2724us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:00.527337 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:00.528630 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:00.531239 (+ 2609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:00.531878 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:00.536554 (+ 4676us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:00.536816 (+ 262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:00.536822 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:00.536827 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:00.536855 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:00.540424 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:00.541518 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:00.541523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:00.541527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:00.541704 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:00.542294 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:00.542299 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:00.542301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:00.542658 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:00.546886 (+ 4228us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:00.547042 (+ 156us) server_negotiation.cc:299] Negotiation successful
0805 22:56:00.547298 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17861,"thread_start_us":17725,"threads_started":1}
I20260805 22:56:00.549875 5155 heartbeater.cc:347] Connected to a master server at 127.20.34.126:37217
I20260805 22:56:00.550321 5155 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:00.551445 5155 heartbeater.cc:511] Master 127.20.34.126:37217 requested a full tablet report, sending...
I20260805 22:56:00.555472 4812 ts_manager.cc:194] Registered new tserver with Master: e7e2cf9652bf42809312ed7c1e709c19 (127.20.34.65:42059)
I20260805 22:56:00.557823 4812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:56377
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Aug 05 22:56:00 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970560, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
W20260805 22:56:00.631264 20617 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.20.34.66: real 0.122s user 0.002s sys 0.027s
I20260805 22:56:00.632483 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:49339/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:37217
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:56:00 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970560, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
W20260805 22:56:01.164610 5166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:01.165177 5166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:01.165383 5166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:01.177403 5166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:01.177678 5166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:01.177953 5166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:56:01.194500 5166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.34.84:49339/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:37217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:01.196511 5166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:01.198470 5166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:01.234483 5179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:01.238657 5178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:01.241392 5182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:01.242023 5166 server_base.cc:1034] running on GCE node
I20260805 22:56:01.243099 5166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:01.249469 5166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:01.251044 5166 hybrid_clock.cc:648] HybridClock initialized: now 1785970561250923 us; error 121 us; skew 500 ppm
I20260805 22:56:01.251579 5166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:01 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970561, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:01.256610 5166 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:56:01.277951 5166 webserver.cc:460] Webserver started at http://127.20.34.66:41125/ using document root <none> and password file <none>
I20260805 22:56:01.279153 5166 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:01.279452 5166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:56:01.279958 5166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:56:01 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970561, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:01.300031 5166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "c833aea7c8464b70965ce3c123725eea"
format_stamp: "Formatted at 2026-08-05 22:56:01 on dist-test-slave-gmjp"
server_key: "a054d73fd6a7b11840fdb31020e59eb0"
server_key_iv: "cb92d28826769a73fc71821c498391a9"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:01.301486 5166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "c833aea7c8464b70965ce3c123725eea"
format_stamp: "Formatted at 2026-08-05 22:56:01 on dist-test-slave-gmjp"
server_key: "a054d73fd6a7b11840fdb31020e59eb0"
server_key_iv: "cb92d28826769a73fc71821c498391a9"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:01.323099 5166 fs_manager.cc:691] Time spent creating directory manager: real 0.021s user 0.013s sys 0.004s
I20260805 22:56:01.365675 5202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:01.367844 5166 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.004s sys 0.004s
I20260805 22:56:01.368129 5166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "c833aea7c8464b70965ce3c123725eea"
format_stamp: "Formatted at 2026-08-05 22:56:01 on dist-test-slave-gmjp"
server_key: "a054d73fd6a7b11840fdb31020e59eb0"
server_key_iv: "cb92d28826769a73fc71821c498391a9"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:01.368505 5166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:01.402832 5166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:01.408784 5166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:01.409173 5166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:01.410485 5166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:01.412580 5166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:01.412683 5166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:01.412864 5166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:01.412951 5166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:01.465919 5166 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:46241
I20260805 22:56:01.466094 5363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:46241 every 8 connection(s)
I20260805 22:56:01.467856 5166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:56:01.476634 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 5166
I20260805 22:56:01.476833 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:56:01.477419 20617 external_mini_cluster.cc:1428] Setting key 8a7efd15fc8d9b326ad7993a0acfb49a
Aug 05 22:56:01 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970561, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:01.491763 5367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:01.471221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:50719 (local address 127.20.34.126:37217)
0805 22:56:01.471725 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:01.471731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:01.473003 (+ 1272us) server_negotiation.cc:407] Connection header received
0805 22:56:01.475145 (+ 2142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:01.475150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:01.475240 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:01.475404 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:01.477326 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:01.478309 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:01.480267 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:01.480704 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:01.480815 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:01.485253 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:01.485259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:01.485263 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:01.485300 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:01.488239 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:01.489162 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:01.489174 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:01.489177 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:01.489309 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:01.489824 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:01.489828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:01.489830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:01.490136 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:01.490306 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:01.491097 (+ 791us) server_negotiation.cc:299] Negotiation successful
0805 22:56:01.491356 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":229,"threads_started":1}
I20260805 22:56:01.492904 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:01.471954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:37217 (local address 127.20.34.66:50719)
0805 22:56:01.472757 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:01.472836 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:01.474840 (+ 2004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:01.475618 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:01.475627 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:01.476117 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:01.477122 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:01.477150 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:01.478503 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:01.478510 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:01.480057 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:01.480074 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:01.480959 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:01.480969 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:01.481328 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:01.482126 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:01.482165 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:01.484959 (+ 2794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:01.488438 (+ 3479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:01.488458 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:01.488477 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:01.488998 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:01.489437 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:01.489443 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:01.489446 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:01.489684 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:01.490282 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:01.490292 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:01.490688 (+ 396us) client_negotiation.cc:769] Sending connection context
0805 22:56:01.490987 (+ 299us) client_negotiation.cc:240] Negotiation successful
0805 22:56:01.491589 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":309,"threads_started":1}
I20260805 22:56:01.494580 5364 heartbeater.cc:347] Connected to a master server at 127.20.34.126:37217
I20260805 22:56:01.494915 5364 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:01.495661 5364 heartbeater.cc:511] Master 127.20.34.126:37217 requested a full tablet report, sending...
I20260805 22:56:01.497339 4812 ts_manager.cc:194] Registered new tserver with Master: c833aea7c8464b70965ce3c123725eea (127.20.34.66:46241)
I20260805 22:56:01.498677 4812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:50719
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:56:01.552037 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:49339/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:37217
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:56:01.562810 5155 heartbeater.cc:503] Master 127.20.34.126:37217 was elected leader, sending a full tablet report...
W20260805 22:56:01.933144 5373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:01.933524 5373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:01.933694 5373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:01.941324 5373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:01.941530 5373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:01.941788 5373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:56:01.952497 5373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.34.84:49339/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:37217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:01.954012 5373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:01.955389 5373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:01.969368 5382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:01.969421 5384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:01.969688 5380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:01.970546 5373 server_base.cc:1034] running on GCE node
I20260805 22:56:01.971274 5373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:01.972510 5373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:01.973755 5373 hybrid_clock.cc:648] HybridClock initialized: now 1785970561973698 us; error 53 us; skew 500 ppm
I20260805 22:56:01.974175 5373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:01 dist-test-slave-gmjp krb5kdc[4095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970561, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:01.977849 5373 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:56:01.979592 5373 webserver.cc:460] Webserver started at http://127.20.34.67:36867/ using document root <none> and password file <none>
I20260805 22:56:01.980373 5373 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:01.980490 5373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:56:01.980772 5373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:56:01 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970561, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:01.996032 5373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "6a0d3259157e4c85837311591b67bca7"
format_stamp: "Formatted at 2026-08-05 22:56:01 on dist-test-slave-gmjp"
server_key: "b7b297bbc76c0888dcfb3cbf77ed24e2"
server_key_iv: "9944283880ce28d35bc7e5a6cd102a26"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:01.997102 5373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "6a0d3259157e4c85837311591b67bca7"
format_stamp: "Formatted at 2026-08-05 22:56:01 on dist-test-slave-gmjp"
server_key: "b7b297bbc76c0888dcfb3cbf77ed24e2"
server_key_iv: "9944283880ce28d35bc7e5a6cd102a26"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:02.003768 5373 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260805 22:56:02.023597 5395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:02.025612 5373 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:56:02.025849 5373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "6a0d3259157e4c85837311591b67bca7"
format_stamp: "Formatted at 2026-08-05 22:56:01 on dist-test-slave-gmjp"
server_key: "b7b297bbc76c0888dcfb3cbf77ed24e2"
server_key_iv: "9944283880ce28d35bc7e5a6cd102a26"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:02.026126 5373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:02.044561 5373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:02.049254 5373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:02.049610 5373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:02.050755 5373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:02.052472 5373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:02.052588 5373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:02.052747 5373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:02.052824 5373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:02.090468 5373 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:43989
I20260805 22:56:02.090514 5567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:43989 every 8 connection(s)
I20260805 22:56:02.091864 5373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:56:02.097316 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 5373
I20260805 22:56:02.097581 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:56:02.098066 20617 external_mini_cluster.cc:1428] Setting key 9d98bd91ed4622a2f6d116955dc70ec8
Aug 05 22:56:02 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970561, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:02.115125 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.094816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:36191 (local address 127.20.34.126:37217)
0805 22:56:02.095401 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.095410 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.096761 (+ 1351us) server_negotiation.cc:407] Connection header received
0805 22:56:02.098872 (+ 2111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.098879 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.098998 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.099128 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:02.100945 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.101973 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.103586 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.104039 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.104139 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.108085 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:02.108091 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:02.108094 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:02.108132 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:02.111198 (+ 3066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.112145 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.112190 (+ 45us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.112195 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.112387 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.112999 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.113005 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.113011 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.113432 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:02.113618 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.114636 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.114842 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":275,"threads_started":1}
I20260805 22:56:02.116225 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.095484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:37217 (local address 127.20.34.67:36191)
0805 22:56:02.096296 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:02.096337 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:02.098530 (+ 2193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:02.099421 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:02.099430 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:02.099984 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:02.100757 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.100777 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.102121 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.102125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.103436 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.103450 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.104318 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.104324 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.104613 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.105414 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:02.105439 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:02.107805 (+ 2366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:02.111382 (+ 3577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:02.111391 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:02.111408 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:02.111985 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:02.112520 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:02.112528 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:02.112531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:02.112811 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:02.113610 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:02.113616 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:02.114109 (+ 493us) client_negotiation.cc:769] Sending connection context
0805 22:56:02.114467 (+ 358us) client_negotiation.cc:240] Negotiation successful
0805 22:56:02.114986 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":313,"threads_started":1}
I20260805 22:56:02.117862 5569 heartbeater.cc:347] Connected to a master server at 127.20.34.126:37217
I20260805 22:56:02.118232 5569 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:02.119127 5569 heartbeater.cc:511] Master 127.20.34.126:37217 requested a full tablet report, sending...
I20260805 22:56:02.120898 4812 ts_manager.cc:194] Registered new tserver with Master: 6a0d3259157e4c85837311591b67bca7 (127.20.34.67:43989)
I20260805 22:56:02.121738 4812 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:36191
I20260805 22:56:02.127144 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:56:02.146905 5571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.132137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32804 (local address 127.20.34.126:37217)
0805 22:56:02.132407 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.132412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.132923 (+ 511us) server_negotiation.cc:407] Connection header received
0805 22:56:02.133079 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.133083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.133175 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.133274 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:02.134980 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.135875 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.137387 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.137896 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.138014 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.141230 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:02.141247 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:02.141250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:02.141294 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:02.144282 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.145131 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.145135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.145138 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.145272 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.145667 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.145671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.145673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.145951 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:02.146136 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.146479 (+ 343us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.146670 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260805 22:56:02.152052 4812 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:56:02.160324 4812 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:56:02.199270 5585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.175138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33546 (local address 127.20.34.65:42059)
0805 22:56:02.186326 (+ 11188us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.186340 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.188023 (+ 1683us) server_negotiation.cc:407] Connection header received
0805 22:56:02.188146 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.188186 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.188495 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.188703 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:02.190036 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.192299 (+ 2263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.195402 (+ 3103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.197303 (+ 1901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.197466 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.197755 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.198648 (+ 893us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.198859 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10886,"thread_start_us":11238,"threads_started":1}
I20260805 22:56:02.199443 5587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.175113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:43989 (local address 127.0.0.1:48672)
0805 22:56:02.188371 (+ 13258us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:02.188401 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:02.188590 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:02.190410 (+ 1820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:02.190419 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:02.190462 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:02.191059 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.191077 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.193881 (+ 2804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.193890 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.196044 (+ 2154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.196062 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.198012 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.198018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.198395 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.198484 (+ 89us) client_negotiation.cc:769] Sending connection context
0805 22:56:02.198587 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:56:02.198869 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13048,"mutex_wait_us":124,"thread_start_us":13599,"threads_started":1}
I20260805 22:56:02.199483 5588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.175605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48672 (local address 127.20.34.67:43989)
0805 22:56:02.189579 (+ 13974us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.189588 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.189625 (+ 37us) server_negotiation.cc:407] Connection header received
0805 22:56:02.189737 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.189747 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.190083 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.191387 (+ 1304us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:02.191793 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.193683 (+ 1890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.196254 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.197796 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.197938 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.198171 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.198803 (+ 632us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.199043 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13782,"thread_start_us":13563,"threads_started":1}
I20260805 22:56:02.201930 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.188658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41870 (local address 127.20.34.66:46241)
0805 22:56:02.192914 (+ 4256us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.192923 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.193581 (+ 658us) server_negotiation.cc:407] Connection header received
0805 22:56:02.193712 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.193721 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.193980 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.194992 (+ 1012us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:02.195256 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.196421 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.199045 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.200539 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.200757 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.200950 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.201436 (+ 486us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.201614 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4068,"thread_start_us":3934,"threads_started":1}
I20260805 22:56:02.201959 5590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.189618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:46241 (local address 127.0.0.1:41870)
0805 22:56:02.193288 (+ 3670us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:02.193314 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:02.193459 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:02.194206 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:02.194212 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:02.194237 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:02.194781 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.194796 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.196584 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.196589 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.198851 (+ 2262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.198865 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.200859 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.200869 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.201074 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.201191 (+ 117us) client_negotiation.cc:769] Sending connection context
0805 22:56:02.201308 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 22:56:02.201510 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3524,"mutex_wait_us":121,"thread_start_us":3370,"threads_started":1}
I20260805 22:56:02.204569 5584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.175001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:42059 (local address 127.0.0.1:33546)
0805 22:56:02.187482 (+ 12481us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:02.187534 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:02.187774 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:02.189094 (+ 1320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:02.189107 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:02.189156 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:02.189739 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.189758 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.192468 (+ 2710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.192474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.195205 (+ 2731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.195220 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.197944 (+ 2724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.197950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.198339 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.198412 (+ 73us) client_negotiation.cc:769] Sending connection context
0805 22:56:02.198587 (+ 175us) client_negotiation.cc:240] Negotiation successful
0805 22:56:02.199845 (+ 1258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12144,"mutex_wait_us":1108,"thread_start_us":12323,"threads_started":1}
I20260805 22:56:02.204454 5467 tablet_service.cc:1467] Processing CreateTablet for tablet 3692d61c190441eb89431da900bd2f68 (DEFAULT_TABLE table=test-table [id=54c55a0c3e19409386aa56b903685faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:56:02.206305 5467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3692d61c190441eb89431da900bd2f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:56:02.205972 5267 tablet_service.cc:1467] Processing CreateTablet for tablet 3692d61c190441eb89431da900bd2f68 (DEFAULT_TABLE table=test-table [id=54c55a0c3e19409386aa56b903685faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:56:02.207520 5267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3692d61c190441eb89431da900bd2f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:56:02.208705 5053 tablet_service.cc:1467] Processing CreateTablet for tablet 3692d61c190441eb89431da900bd2f68 (DEFAULT_TABLE table=test-table [id=54c55a0c3e19409386aa56b903685faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:56:02.209857 5053 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3692d61c190441eb89431da900bd2f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:56:02.222892 5591 tablet_bootstrap.cc:492] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Bootstrap starting.
I20260805 22:56:02.227303 5591 tablet_bootstrap.cc:654] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Neither blocks nor log segments found. Creating new log.
I20260805 22:56:02.228529 5591 log.cc:824] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Log is configured to *not* fsync() on all Append() calls
I20260805 22:56:02.229874 5593 tablet_bootstrap.cc:492] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Bootstrap starting.
I20260805 22:56:02.232733 5591 tablet_bootstrap.cc:492] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: No bootstrap required, opened a new log
I20260805 22:56:02.233042 5591 ts_tablet_manager.cc:1397] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260805 22:56:02.233083 5595 tablet_bootstrap.cc:492] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: Bootstrap starting.
I20260805 22:56:02.234802 5593 tablet_bootstrap.cc:654] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Neither blocks nor log segments found. Creating new log.
I20260805 22:56:02.236105 5593 log.cc:824] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:56:02.237856 5595 tablet_bootstrap.cc:654] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: Neither blocks nor log segments found. Creating new log.
I20260805 22:56:02.239220 5595 log.cc:824] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: Log is configured to *not* fsync() on all Append() calls
I20260805 22:56:02.239598 5593 tablet_bootstrap.cc:492] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: No bootstrap required, opened a new log
I20260805 22:56:02.239912 5593 ts_tablet_manager.cc:1397] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Time spent bootstrapping tablet: real 0.010s user 0.010s sys 0.000s
I20260805 22:56:02.244822 5591 raft_consensus.cc:348] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.245361 5591 raft_consensus.cc:374] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:56:02.245466 5591 raft_consensus.cc:729] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7e2cf9652bf42809312ed7c1e709c19, State: Initialized, Role: FOLLOWER
I20260805 22:56:02.245842 5595 tablet_bootstrap.cc:492] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: No bootstrap required, opened a new log
I20260805 22:56:02.246140 5595 ts_tablet_manager.cc:1397] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.005s
I20260805 22:56:02.246158 5591 consensus_queue.cc:260] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.248291 5591 ts_tablet_manager.cc:1428] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260805 22:56:02.250631 5593 raft_consensus.cc:348] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.251080 5593 raft_consensus.cc:374] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:56:02.251222 5593 raft_consensus.cc:729] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a0d3259157e4c85837311591b67bca7, State: Initialized, Role: FOLLOWER
I20260805 22:56:02.252012 5593 consensus_queue.cc:260] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.253391 5569 heartbeater.cc:503] Master 127.20.34.126:37217 was elected leader, sending a full tablet report...
I20260805 22:56:02.254226 5593 ts_tablet_manager.cc:1428] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260805 22:56:02.257046 5595 raft_consensus.cc:348] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.257596 5595 raft_consensus.cc:374] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:56:02.257722 5595 raft_consensus.cc:729] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c833aea7c8464b70965ce3c123725eea, State: Initialized, Role: FOLLOWER
I20260805 22:56:02.258482 5595 consensus_queue.cc:260] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.259824 5364 heartbeater.cc:503] Master 127.20.34.126:37217 was elected leader, sending a full tablet report...
I20260805 22:56:02.260563 5595 ts_tablet_manager.cc:1428] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
W20260805 22:56:02.262871 5157 tablet.cc:2369] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:56:02.325421 5602 raft_consensus.cc:482] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:56:02.325770 5602 raft_consensus.cc:504] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.327677 5602 leader_election.cc:288] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7e2cf9652bf42809312ed7c1e709c19 (127.20.34.65:42059), c833aea7c8464b70965ce3c123725eea (127.20.34.66:46241)
I20260805 22:56:02.335412 5585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.328388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:37235 (local address 127.20.34.65:42059)
0805 22:56:02.328628 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.328636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.328659 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:56:02.328778 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.328787 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.328898 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.329015 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:02.329522 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.330799 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.333037 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.334473 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.334619 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.334683 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.335048 (+ 365us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.335165 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 22:56:02.335467 5572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.328008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:42059 (local address 127.20.34.67:37235)
0805 22:56:02.328280 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:02.328308 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:02.328501 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:02.329082 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:02.329090 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:02.329125 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:02.329336 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.329345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.330967 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.330974 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.332841 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.332855 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.334646 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.334652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.334847 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.334896 (+ 49us) client_negotiation.cc:769] Sending connection context
0805 22:56:02.335003 (+ 107us) client_negotiation.cc:240] Negotiation successful
0805 22:56:02.335169 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260805 22:56:02.336781 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.328730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:33997 (local address 127.20.34.66:46241)
0805 22:56:02.328977 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.328983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.329504 (+ 521us) server_negotiation.cc:407] Connection header received
0805 22:56:02.329833 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.329837 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.329900 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.329969 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:02.330695 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.331833 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.334382 (+ 2549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.335646 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.335832 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.335916 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.336384 (+ 468us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.336523 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:56:02.336844 5606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.328507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:46241 (local address 127.20.34.67:33997)
0805 22:56:02.329381 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:02.329397 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:02.329626 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:02.330028 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:02.330034 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:02.330062 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:02.330530 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.330544 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.332003 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.332007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.334175 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:02.334192 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.336019 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.336024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:02.336148 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.336228 (+ 80us) client_negotiation.cc:769] Sending connection context
0805 22:56:02.336344 (+ 116us) client_negotiation.cc:240] Negotiation successful
0805 22:56:02.336488 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":390,"threads_started":1}
I20260805 22:56:02.336694 5087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3692d61c190441eb89431da900bd2f68" candidate_uuid: "6a0d3259157e4c85837311591b67bca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7e2cf9652bf42809312ed7c1e709c19" is_pre_election: true
I20260805 22:56:02.337387 5087 raft_consensus.cc:2454] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a0d3259157e4c85837311591b67bca7 in term 0.
I20260805 22:56:02.337877 5292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3692d61c190441eb89431da900bd2f68" candidate_uuid: "6a0d3259157e4c85837311591b67bca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c833aea7c8464b70965ce3c123725eea" is_pre_election: true
I20260805 22:56:02.338263 5397 leader_election.cc:302] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a0d3259157e4c85837311591b67bca7, e7e2cf9652bf42809312ed7c1e709c19; no voters:
I20260805 22:56:02.338343 5292 raft_consensus.cc:2454] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a0d3259157e4c85837311591b67bca7 in term 0.
I20260805 22:56:02.338754 5602 raft_consensus.cc:2781] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:56:02.338963 5602 raft_consensus.cc:482] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:56:02.339102 5602 raft_consensus.cc:3037] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:56:02.341673 5602 raft_consensus.cc:504] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.342365 5602 leader_election.cc:288] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [CANDIDATE]: Term 1 election: Requested vote from peers e7e2cf9652bf42809312ed7c1e709c19 (127.20.34.65:42059), c833aea7c8464b70965ce3c123725eea (127.20.34.66:46241)
I20260805 22:56:02.343009 5087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3692d61c190441eb89431da900bd2f68" candidate_uuid: "6a0d3259157e4c85837311591b67bca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7e2cf9652bf42809312ed7c1e709c19"
I20260805 22:56:02.343044 5292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3692d61c190441eb89431da900bd2f68" candidate_uuid: "6a0d3259157e4c85837311591b67bca7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c833aea7c8464b70965ce3c123725eea"
I20260805 22:56:02.343256 5087 raft_consensus.cc:3037] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:56:02.343261 5292 raft_consensus.cc:3037] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 0 FOLLOWER]: Advancing to term 1
W20260805 22:56:02.343698 5570 tablet.cc:2369] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:56:02.345966 5087 raft_consensus.cc:2454] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a0d3259157e4c85837311591b67bca7 in term 1.
I20260805 22:56:02.345983 5292 raft_consensus.cc:2454] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a0d3259157e4c85837311591b67bca7 in term 1.
I20260805 22:56:02.346490 5397 leader_election.cc:302] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a0d3259157e4c85837311591b67bca7, e7e2cf9652bf42809312ed7c1e709c19; no voters:
I20260805 22:56:02.346854 5602 raft_consensus.cc:2781] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:56:02.347354 5602 raft_consensus.cc:686] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 1 LEADER]: Becoming Leader. State: Replica: 6a0d3259157e4c85837311591b67bca7, State: Running, Role: LEADER
I20260805 22:56:02.347958 5602 consensus_queue.cc:237] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } }
I20260805 22:56:02.353224 4812 catalog_manager.cc:5495] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a0d3259157e4c85837311591b67bca7 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "6a0d3259157e4c85837311591b67bca7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a0d3259157e4c85837311591b67bca7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 43989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20260805 22:56:02.402626 5588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.396416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40168 (local address 127.20.34.67:43989)
0805 22:56:02.396621 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.396626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.396645 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:56:02.396738 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.396741 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.396853 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.397002 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:56:02.397459 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.398254 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.400032 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.400621 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.400805 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.401364 (+ 559us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:56:02.401928 (+ 564us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:56:02.402047 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.402219 (+ 172us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.402296 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 22:56:02.411533 5292 raft_consensus.cc:1261] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 1 FOLLOWER]: Refusing update from remote peer 6a0d3259157e4c85837311591b67bca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:56:02.411542 5087 raft_consensus.cc:1261] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 1 FOLLOWER]: Refusing update from remote peer 6a0d3259157e4c85837311591b67bca7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:56:02.412642 5608 consensus_queue.cc:1035] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c833aea7c8464b70965ce3c123725eea" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:56:02.413040 5602 consensus_queue.cc:1035] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7e2cf9652bf42809312ed7c1e709c19" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 42059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:56:02.441735 4811 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:56:02.442047 4811 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:56:02.446336 4811 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f11c25ea11214b418ea83a607a4399af: Sending DeleteTablet for 3 replicas of tablet 3692d61c190441eb89431da900bd2f68
I20260805 22:56:02.448058 5267 tablet_service.cc:1514] Processing DeleteTablet for tablet 3692d61c190441eb89431da900bd2f68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:56:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:41870
I20260805 22:56:02.448086 5467 tablet_service.cc:1514] Processing DeleteTablet for tablet 3692d61c190441eb89431da900bd2f68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:56:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:48672
I20260805 22:56:02.448339 5053 tablet_service.cc:1514] Processing DeleteTablet for tablet 3692d61c190441eb89431da900bd2f68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:56:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:33546
I20260805 22:56:02.451046 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 4935
I20260805 22:56:02.458269 5623 tablet_replica.cc:330] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: stopping tablet replica
I20260805 22:56:02.458770 5626 tablet_replica.cc:330] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: stopping tablet replica
I20260805 22:56:02.458860 5623 raft_consensus.cc:2229] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:56:02.459528 5626 raft_consensus.cc:2229] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:56:02.459654 5623 raft_consensus.cc:2258] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:56:02.460721 5624 tablet_replica.cc:330] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: stopping tablet replica
I20260805 22:56:02.461093 5624 raft_consensus.cc:2229] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:56:02.461558 5624 raft_consensus.cc:2258] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:56:02.462070 5626 raft_consensus.cc:2258] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:56:02.462121 5623 ts_tablet_manager.cc:1905] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:56:02.464126 5624 ts_tablet_manager.cc:1905] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:56:02.464138 5626 ts_tablet_manager.cc:1905] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:56:02.470494 5623 ts_tablet_manager.cc:1918] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:56:02.470705 5623 log.cc:1196] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/3692d61c190441eb89431da900bd2f68
I20260805 22:56:02.471329 5623 ts_tablet_manager.cc:1939] T 3692d61c190441eb89431da900bd2f68 P 6a0d3259157e4c85837311591b67bca7: Deleting consensus metadata
I20260805 22:56:02.472034 5626 ts_tablet_manager.cc:1918] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:56:02.472330 5626 log.cc:1196] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/3692d61c190441eb89431da900bd2f68
I20260805 22:56:02.472885 5626 ts_tablet_manager.cc:1939] T 3692d61c190441eb89431da900bd2f68 P e7e2cf9652bf42809312ed7c1e709c19: Deleting consensus metadata
I20260805 22:56:02.473506 4794 catalog_manager.cc:4841] TS 6a0d3259157e4c85837311591b67bca7 (127.20.34.67:43989): tablet 3692d61c190441eb89431da900bd2f68 (table test-table [id=54c55a0c3e19409386aa56b903685faf]) successfully deleted
I20260805 22:56:02.474723 4793 catalog_manager.cc:4841] TS e7e2cf9652bf42809312ed7c1e709c19 (127.20.34.65:42059): tablet 3692d61c190441eb89431da900bd2f68 (table test-table [id=54c55a0c3e19409386aa56b903685faf]) successfully deleted
Aug 05 22:56:02 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:56:02.481343 5624 ts_tablet_manager.cc:1918] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:56:02.481529 5624 log.cc:1196] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/3692d61c190441eb89431da900bd2f68
I20260805 22:56:02.482342 5624 ts_tablet_manager.cc:1939] T 3692d61c190441eb89431da900bd2f68 P c833aea7c8464b70965ce3c123725eea: Deleting consensus metadata
I20260805 22:56:02.484644 4793 catalog_manager.cc:4841] TS c833aea7c8464b70965ce3c123725eea (127.20.34.66:46241): tablet 3692d61c190441eb89431da900bd2f68 (table test-table [id=54c55a0c3e19409386aa56b903685faf]) successfully deleted
I20260805 22:56:02.488950 5585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.453010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60200 (local address 127.20.34.65:42059)
0805 22:56:02.453292 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.453302 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.456812 (+ 3510us) server_negotiation.cc:407] Connection header received
0805 22:56:02.457199 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.457209 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.457367 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.457467 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:02.463158 (+ 5691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.464320 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.466506 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.467213 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.467340 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.480555 (+ 13215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:02.480573 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:02.480592 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:02.480649 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:02.485457 (+ 4808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.486399 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.486407 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.486410 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.486560 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.487038 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.487042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.487045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.487456 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:02.487824 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.488227 (+ 403us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.488479 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260805 22:56:02.489787 5148 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:56:02.586265 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 4935
I20260805 22:56:02.613159 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 5166
Aug 05 22:56:02 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:56:02.631417 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.614059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54754 (local address 127.20.34.66:46241)
0805 22:56:02.614283 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.614290 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.614313 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:56:02.614399 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.614405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.614490 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.614605 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:02.615809 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.617052 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.618950 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.619619 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.619762 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.624936 (+ 5174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:02.624953 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:02.624971 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:02.625016 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:02.628032 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.628993 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.629002 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.629004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.629147 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.629590 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.629593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.629596 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.630075 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:02.630416 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.630758 (+ 342us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.630995 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 22:56:02.632220 5359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:56:02.741529 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 5166
I20260805 22:56:02.776103 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 5373
Aug 05 22:56:02 dist-test-slave-gmjp krb5kdc[4095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:56:02.796262 5588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:02.777290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40178 (local address 127.20.34.67:43989)
0805 22:56:02.777493 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:02.777499 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:02.777552 (+ 53us) server_negotiation.cc:407] Connection header received
0805 22:56:02.777757 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:02.777764 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:02.777871 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:02.777985 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:02.779905 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.781130 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.783151 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:02.783816 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:02.783993 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:02.789498 (+ 5505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:02.789520 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:02.789540 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:02.789593 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:02.792941 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.793925 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.793934 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.793936 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.794103 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:02.794645 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:02.794648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:02.794650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:02.795032 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:02.795287 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:02.795712 (+ 425us) server_negotiation.cc:299] Negotiation successful
0805 22:56:02.795900 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:56:02.797155 5563 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:56:02.929085 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 5373
I20260805 22:56:02.959128 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 4768
I20260805 22:56:02.960521 4852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:56:03.076449 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 4768
I20260805 22:56:03.109004 20617 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260805 22:56:03.459524 20617 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260805 22:56:03.459781 20617 mini_ranger.cc:66] Stopping Ranger...
I20260805 22:56:03.816468 20617 mini_ranger.cc:68] Stopped Ranger
2026-08-05 22:56:03.816 UTC [4135] LOG: received smart shutdown request
2026-08-05 22:56:03.821 UTC [4135] LOG: background worker "logical replication launcher" (PID 4153) exited with exit code 1
2026-08-05 22:56:03.821 UTC [4140] LOG: shutting down
2026-08-05 22:56:04.023 UTC [4135] LOG: database system is shut down
2026-08-05T22:56:04Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54635 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:56:04 dist-test-slave-gmjp krb5kdc[5654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:56:04 dist-test-slave-gmjp krb5kdc[5654](info): set up 2 sockets
Aug 05 22:56:04 dist-test-slave-gmjp krb5kdc[5654](info): commencing operation
krb5kdc: starting...
W20260805 22:56:05.505687 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:56:05 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:56:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:56:05Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.34.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.34.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/rangeradmin_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/rangeradmin_127.20.34.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.34.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.34.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/rangerlookup_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/rangerlookup_127.20.34.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.34.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.34.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/HTTP_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/HTTP_127.20.34.84@KRBTEST.COM.keytab.
I20260805 22:56:05.963068 20617 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskj1qIwm/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/postgres -l logfile start
2026-08-05 22:56:08.635 UTC [5701] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-05 22:56:08.635 UTC [5701] LOG: listening on IPv4 address "127.20.34.84", port 43049
2026-08-05 22:56:08.638 UTC [5701] LOG: listening on Unix socket "/tmp/.s.PGSQL.43049"
2026-08-05 22:56:08.664 UTC [5707] LOG: database system was shut down at 2026-08-05 22:56:07 UTC
2026-08-05 22:56:08.669 UTC [5701] LOG: database system is ready to accept connections
I20260805 22:56:09.865010 20617 mini_postgres.cc:96] Postgres bound to 43049
2026-08-05 22:56:09.892 UTC [5719] FATAL: database "slave" does not exist
127.20.34.84:43049 - accepting connections
I20260805 22:56:09.892810 20617 mini_ranger.cc:161] Starting Ranger...
I20260805 22:56:09.927968 20617 mini_ranger.cc:84] Created miniranger Postgres user
I20260805 22:56:10.416762 20617 mini_ranger.cc:87] Created ranger Postgres database
I20260805 22:56:10.416916 20617 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-admin
2026-08-05 22:56:10,727 [I] DB FLAVOR :POSTGRES
2026-08-05 22:56:10,728 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:56:10,728 [I] Checking connection..
2026-08-05 22:56:10,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-05 22:56:11,010 [I] Checking connection passed.
2026-08-05 22:56:11,010 [I] --------- Verifying version history table ---------
2026-08-05 22:56:11,010 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:56:11,292 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:56:11,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:56:11,570 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 22:56:11,570 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-05 22:56:11,570 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-05 22:56:11.838 UTC [5823] WARNING: there is no transaction in progress
2026-08-05 22:56:11,845 [I] create_dbversion_catalog.sql file imported successfully
2026-08-05 22:56:11,846 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 22:56:12,129 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-05 22:56:12,129 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:56:12,129 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-05 22:56:12,412 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-05 22:56:12,685 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gmjp.c.gcp-upstream.internal','N') ;"
2026-08-05 22:56:12,945 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:56:13,219 [I] Table x_portal_user does not exist in database ranger
2026-08-05 22:56:13,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:56:13,508 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-05 22:56:13,508 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:56:13,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:56:14,026 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-05 22:56:14,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-05 22:56:15.046 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.063 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.081 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.099 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.118 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.139 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.205 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.212 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.228 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.240 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.250 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.264 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.275 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.282 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.290 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15.298 UTC [6001] WARNING: there is no transaction in progress
2026-08-05 22:56:15,985 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-05 22:56:15,986 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-05 22:56:16,230 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-05 22:56:16,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 22:56:16,505 [I] Table x_portal_user already exists in database 'ranger'
2026-08-05 22:56:16,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 22:56:16,780 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-05 22:56:16,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 22:56:17,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 22:56:17,328 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gmjp.c.gcp-upstream.internal';"
2026-08-05 22:56:17,592 [I] CORE_DB_SCHEMA import status has been updated
2026-08-05 22:56:17,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-05 22:56:17,861 [I] DB_PATCHES have already been applied
I20260805 22:56:17.868321 20617 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-admin:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskj1qIwm/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260805 22:56:17.868451 20617 mini_ranger.cc:193] Using host: 127.20.34.84
I20260805 22:56:17.892984 20617 mini_ranger.cc:227] Ranger admin URL: http://127.20.34.84:38251
Aug 05, 2026 10:56:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:56:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:56:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-admin/ews/webapp
Aug 05, 2026 10:56:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 05, 2026 10:56:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 05, 2026 10:56:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-admin/ews/webapp].
Aug 05, 2026 10:56:18 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260805 22:56:19.296929 20617 mini_ranger.cc:160] Time spent starting Ranger: real 9.404s user 0.008s sys 0.066s
Aug 05, 2026 10:56:39 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 05, 2026 10:56:39 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 05, 2026 10:56:39 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 05, 2026 10:56:39 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 05, 2026 10:56:40 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260805 22:56:41.323348 20617 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.34.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.34.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/rangerkms_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.34.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/rangerkms_127.20.34.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.34.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.34.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.34.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/HTTP_127.20.34.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.34.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/HTTP_127.20.34.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 05 22:56:41 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970601, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260805 22:56:41.577134 20617 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260805 22:56:41.608352 20617 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260805 22:56:42.520586 20617 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260805 22:56:42.520712 20617 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms
I20260805 22:56:42.520761 20617 mini_ranger_kms.cc:227] Using postgres at 127.20.34.84:43049
2026-08-05 22:56:42,923 [I] DB FLAVOR :POSTGRES
2026-08-05 22:56:42,923 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 22:56:42,923 [I] Checking connection
2026-08-05 22:56:42,923 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-05 22:56:43,178 [I] connection success
2026-08-05 22:56:43,178 [I] --------- Verifying Ranger DB tables ---------
2026-08-05 22:56:43,178 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-05 22:56:43,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-05 22:56:43,454 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-05 22:56:43,454 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 22:56:43,454 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-05 22:56:43,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.34.84:43049/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-05 22:56:43,736 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260805 22:56:44.247349 20617 mini_ranger_kms.cc:310] Created kms service
I20260805 22:56:44.489733 20617 mini_ranger_kms.cc:326] Created kudu user
I20260805 22:56:44.538730 20617 mini_ranger_kms.cc:343] Created rangerkms user
Aug 05 22:56:44 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970601, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:45.042061 20617 mini_ranger_kms.cc:384] Added ranger policy
I20260805 22:56:45.042471 20617 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms:/tmp/dist-test-taskj1qIwm/build/asan/bin/postgresql.jar:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskj1qIwm/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260805 22:56:45.042541 20617 mini_ranger_kms.cc:240] Using host: 127.20.34.84
I20260805 22:56:45.072597 20617 mini_ranger_kms.cc:276] Ranger KMS PID: 6299
I20260805 22:56:45.072760 20617 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.34.84:38461
Aug 05, 2026 10:56:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 10:56:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 10:56:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 05, 2026 10:56:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 05, 2026 10:56:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-kms/ews/webapp].
Aug 05, 2026 10:56:46 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 05 22:56:48 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970608, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.34.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:48.286633 20617 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.709s user 0.070s sys 0.379s
I20260805 22:56:48.287117 20617 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260805 22:56:48.287464 20617 mini_ranger_kms.cc:401] 127.20.34.84:38461/kms/v1/keys
Aug 05 22:56:48 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970608, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.34.84@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
Aug 05 22:56:49 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970608, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.34.84@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
Aug 05 22:56:51 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:56:51.859995 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:33975
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:33975
--ranger_config_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:38461/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:56:52.231721 6381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:52.232096 6381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:52.232281 6381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:52.239760 6381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:56:52.239899 6381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:52.239946 6381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:52.240005 6381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:56:52.240056 6381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:56:52.250851 6381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.34.84:38461/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:33975
--ranger_config_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:33975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:52.252333 6381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:52.253731 6381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:52.267392 6390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:52.267433 6391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:52.267566 6381 server_base.cc:1034] running on GCE node
W20260805 22:56:52.267881 6393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:52.269062 6381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:52.270627 6381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:52.271857 6381 hybrid_clock.cc:648] HybridClock initialized: now 1785970612271822 us; error 63 us; skew 500 ppm
I20260805 22:56:52.272307 6381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:52 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970612, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:52.275611 6381 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:56:52.277277 6381 webserver.cc:460] Webserver started at http://127.20.34.126:40979/ using document root <none> and password file <none>
I20260805 22:56:52.277997 6381 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:52.278138 6381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:56:52.278502 6381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:56:52 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970612, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:52.341100 6381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "3eba381b3fb2405c811a1a58b4f6c78b"
format_stamp: "Formatted at 2026-08-05 22:56:52 on dist-test-slave-gmjp"
server_key: "fc6d650821e57b2944410155124a5b98"
server_key_iv: "57795292d764cd9d975505059b84a989"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:52.342790 6381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "3eba381b3fb2405c811a1a58b4f6c78b"
format_stamp: "Formatted at 2026-08-05 22:56:52 on dist-test-slave-gmjp"
server_key: "fc6d650821e57b2944410155124a5b98"
server_key_iv: "57795292d764cd9d975505059b84a989"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:52.350009 6381 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260805 22:56:52.371949 6401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:52.373706 6381 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:56:52.373924 6381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "3eba381b3fb2405c811a1a58b4f6c78b"
format_stamp: "Formatted at 2026-08-05 22:56:52 on dist-test-slave-gmjp"
server_key: "fc6d650821e57b2944410155124a5b98"
server_key_iv: "57795292d764cd9d975505059b84a989"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:52.374158 6381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:52.403515 6381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:52.407886 6381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:52.408321 6381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:52.427906 6381 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:33975
I20260805 22:56:52.427950 6480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:33975 every 8 connection(s)
I20260805 22:56:52.429322 6381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:56:52.433275 6481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:56:52.435243 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 6381
I20260805 22:56:52.435487 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:56:52.436415 20617 external_mini_cluster.cc:1428] Setting key d6474f220bcf51036e6b2b7f386071b2
I20260805 22:56:52.446954 6481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Bootstrap starting.
I20260805 22:56:52.451325 6481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Neither blocks nor log segments found. Creating new log.
Aug 05 22:56:52 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:52.452695 6481 log.cc:824] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:56:52.456633 6481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: No bootstrap required, opened a new log
I20260805 22:56:52.462966 6484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:52.438761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45710 (local address 127.20.34.126:33975)
0805 22:56:52.439708 (+ 947us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:52.439721 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:52.439770 (+ 49us) server_negotiation.cc:407] Connection header received
0805 22:56:52.441582 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:52.441608 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:52.442054 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:52.442388 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:52.444283 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:52.445624 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:52.447583 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:52.448342 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:52.448486 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:52.453707 (+ 5221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:52.453718 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:52.453744 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:52.453789 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:52.457880 (+ 4091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:52.458714 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:52.458723 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:52.458734 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:52.458952 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:52.459315 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:52.459323 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:52.459330 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:52.460147 (+ 817us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:52.460508 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:52.461022 (+ 514us) server_negotiation.cc:299] Negotiation successful
0805 22:56:52.461500 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":472,"threads_started":1}
I20260805 22:56:52.467157 6481 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } }
I20260805 22:56:52.467553 6481 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:56:52.467653 6481 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eba381b3fb2405c811a1a58b4f6c78b, State: Initialized, Role: FOLLOWER
I20260805 22:56:52.468358 6481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } }
I20260805 22:56:52.468622 6481 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:56:52.468765 6481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:56:52.468896 6481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:56:52.471026 6481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } }
I20260805 22:56:52.471485 6481 leader_election.cc:302] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3eba381b3fb2405c811a1a58b4f6c78b; no voters:
I20260805 22:56:52.472136 6481 leader_election.cc:288] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:56:52.472289 6487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:56:52.473202 6487 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 1 LEADER]: Becoming Leader. State: Replica: 3eba381b3fb2405c811a1a58b4f6c78b, State: Running, Role: LEADER
I20260805 22:56:52.473799 6487 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } }
I20260805 22:56:52.474402 6481 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:56:52.476884 6491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eba381b3fb2405c811a1a58b4f6c78b. Latest consensus state: current_term: 1 leader_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } } }
I20260805 22:56:52.477587 6491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: This master's current role is: LEADER
I20260805 22:56:52.477829 6488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } } }
I20260805 22:56:52.478127 6488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: This master's current role is: LEADER
I20260805 22:56:52.480645 6502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:56:52.485667 6502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:56:52.486583 6481 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 22:56:52.506691 6502 catalog_manager.cc:1347] Generated new cluster ID: 95c06bb0040d4dc0b3b5a9f159d84004
I20260805 22:56:52.506920 6502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:56:52.524881 6502 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:56:52.527112 6502 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:56:52.542933 6502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Generated new TSK 0
I20260805 22:56:52.544209 6502 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:56:53.354379 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:38461/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33975
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:56:53 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970613, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260805 22:56:53.791997 6548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:53.792436 6548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:53.792627 6548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:53.800674 6548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:53.800848 6548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:53.801054 6548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:56:53.812498 6548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.34.84:38461/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:53.814391 6548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:53.816196 6548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:53.837898 6563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:53.837937 6564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:53.850687 6548 server_base.cc:1034] running on GCE node
W20260805 22:56:53.852439 6570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:53.853266 6548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:53.854672 6548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:53.855960 6548 hybrid_clock.cc:648] HybridClock initialized: now 1785970613855898 us; error 60 us; skew 500 ppm
I20260805 22:56:53.856420 6548 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:53 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970613, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:53.861276 6548 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:56:53.864774 6548 webserver.cc:460] Webserver started at http://127.20.34.65:35739/ using document root <none> and password file <none>
I20260805 22:56:53.865612 6548 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:53.865779 6548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:56:53.866142 6548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:56:53 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970613, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:53.885352 6548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "438a6188bf5547d38126ed306a5489cd"
format_stamp: "Formatted at 2026-08-05 22:56:53 on dist-test-slave-gmjp"
server_key: "1d485e8e5e4cbb92cce945f868858b4c"
server_key_iv: "6b9255bb78b3b61342d62bc2b02072e6"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:53.886533 6548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "438a6188bf5547d38126ed306a5489cd"
format_stamp: "Formatted at 2026-08-05 22:56:53 on dist-test-slave-gmjp"
server_key: "1d485e8e5e4cbb92cce945f868858b4c"
server_key_iv: "6b9255bb78b3b61342d62bc2b02072e6"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:53.906919 6548 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.015s sys 0.004s
I20260805 22:56:53.944993 6579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:53.947230 6548 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.006s sys 0.003s
I20260805 22:56:53.947489 6548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "438a6188bf5547d38126ed306a5489cd"
format_stamp: "Formatted at 2026-08-05 22:56:53 on dist-test-slave-gmjp"
server_key: "1d485e8e5e4cbb92cce945f868858b4c"
server_key_iv: "6b9255bb78b3b61342d62bc2b02072e6"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:53.947755 6548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:53.971553 6548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:53.976435 6548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:53.976801 6548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:53.978138 6548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:53.979883 6548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:53.979992 6548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:53.980144 6548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:53.980268 6548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260805 22:56:54.072026 6548 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:43627
I20260805 22:56:54.072079 6752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:43627 every 8 connection(s)
I20260805 22:56:54.074148 6548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:56:54.081183 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 6548
I20260805 22:56:54.081429 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:56:54.082335 20617 external_mini_cluster.cc:1428] Setting key 376274a4746691b8e6c36fd242afa166
Aug 05 22:56:54 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970613, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:54.150005 6755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:54.077596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:41075 (local address 127.20.34.126:33975)
0805 22:56:54.118706 (+ 41110us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:54.118714 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:54.118747 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:56:54.122656 (+ 3909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:54.122663 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:54.122791 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:54.122905 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:54.126960 (+ 4055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:54.128222 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:54.131811 (+ 3589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:54.132540 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:54.132648 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:54.141422 (+ 8774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:54.141430 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:54.141435 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:54.141488 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:54.145531 (+ 4043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:54.146750 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:54.146758 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:54.146762 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:54.146941 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:54.147604 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:54.147610 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:54.147613 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:54.148001 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:54.148135 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:54.149328 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0805 22:56:54.149603 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40934,"thread_start_us":40732,"threads_started":1}
I20260805 22:56:54.152562 6756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:54.078279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33975 (local address 127.20.34.65:41075)
0805 22:56:54.110130 (+ 31851us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:54.110191 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:54.122021 (+ 11830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:54.123939 (+ 1918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:54.123955 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:54.124816 (+ 861us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:54.125839 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:54.125870 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:54.129416 (+ 3546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:54.129422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:54.131597 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:54.131615 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:54.133083 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:54.133091 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:54.133419 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:54.136473 (+ 3054us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:54.136515 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:54.141051 (+ 4536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:54.145768 (+ 4717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:54.145782 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:54.145806 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:54.146556 (+ 750us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:54.147133 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:54.147138 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:54.147141 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:54.147452 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:54.148277 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:54.148286 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:54.148825 (+ 539us) client_negotiation.cc:769] Sending connection context
0805 22:56:54.150335 (+ 1510us) client_negotiation.cc:240] Negotiation successful
0805 22:56:54.150938 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28513,"thread_start_us":30527,"threads_started":1}
I20260805 22:56:54.154896 6753 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33975
I20260805 22:56:54.155267 6753 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:54.156268 6753 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
I20260805 22:56:54.159171 6425 ts_manager.cc:194] Registered new tserver with Master: 438a6188bf5547d38126ed306a5489cd (127.20.34.65:43627)
I20260805 22:56:54.161319 6425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:41075
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Aug 05 22:56:54 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970613, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
W20260805 22:56:54.222394 20617 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.20.34.66: real 0.137s user 0.000s sys 0.029s
I20260805 22:56:54.223516 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:38461/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33975
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:56:54 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970613, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
W20260805 22:56:54.744570 6760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:54.745124 6760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:54.745342 6760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:54.757402 6760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:54.757670 6760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:54.757917 6760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:56:54.774559 6760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.34.84:38461/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:54.776865 6760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:54.778893 6760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:54.818524 6777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:54.820564 6775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:54.820813 6782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:54.821183 6760 server_base.cc:1034] running on GCE node
I20260805 22:56:54.822393 6760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:54.829559 6760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:54.831058 6760 hybrid_clock.cc:648] HybridClock initialized: now 1785970614830951 us; error 109 us; skew 500 ppm
I20260805 22:56:54.831552 6760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:54 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970614, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:54.836229 6760 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:56:54.869122 6760 webserver.cc:460] Webserver started at http://127.20.34.66:43331/ using document root <none> and password file <none>
I20260805 22:56:54.870379 6760 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:54.870623 6760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:56:54.871073 6760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:56:54 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970614, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:54.913766 6760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "98fbba65c0b34511b694b0a1a7512b77"
format_stamp: "Formatted at 2026-08-05 22:56:54 on dist-test-slave-gmjp"
server_key: "ed3a628deb253f5c74dfa50a2431a152"
server_key_iv: "f508b263a92aadf9dec41627def95071"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:54.918767 6760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "98fbba65c0b34511b694b0a1a7512b77"
format_stamp: "Formatted at 2026-08-05 22:56:54 on dist-test-slave-gmjp"
server_key: "ed3a628deb253f5c74dfa50a2431a152"
server_key_iv: "f508b263a92aadf9dec41627def95071"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:54.933480 6760 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.008s sys 0.004s
I20260805 22:56:54.982091 6790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:54.984328 6760 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.002s sys 0.007s
I20260805 22:56:54.984651 6760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "98fbba65c0b34511b694b0a1a7512b77"
format_stamp: "Formatted at 2026-08-05 22:56:54 on dist-test-slave-gmjp"
server_key: "ed3a628deb253f5c74dfa50a2431a152"
server_key_iv: "f508b263a92aadf9dec41627def95071"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:54.985005 6760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:55.003737 6760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:55.008302 6760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:55.008626 6760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:55.009830 6760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:55.011579 6760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:55.011693 6760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:55.011860 6760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:55.011935 6760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:55.052326 6760 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:46547
I20260805 22:56:55.052348 6973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:46547 every 8 connection(s)
I20260805 22:56:55.054790 6760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:56:55.062068 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 6760
I20260805 22:56:55.062284 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:56:55.062938 20617 external_mini_cluster.cc:1428] Setting key c71048a7c10f15765ef58f200e1b8b78
Aug 05 22:56:55 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970614, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:55.083079 6980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:55.058807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33975 (local address 127.20.34.66:46935)
0805 22:56:55.059722 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:55.059793 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:55.062204 (+ 2411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:55.063060 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:55.063072 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:55.063707 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:55.064555 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:55.064578 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.066113 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.066118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:55.068118 (+ 2000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:55.068135 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.069330 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.069337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:55.069624 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:55.070510 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:55.070547 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:55.073752 (+ 3205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:55.078198 (+ 4446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:55.078209 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:55.078229 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:55.078920 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:55.079409 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:55.079414 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:55.079418 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:55.079674 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:55.080372 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:55.080381 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:55.080846 (+ 465us) client_negotiation.cc:769] Sending connection context
0805 22:56:55.081141 (+ 295us) client_negotiation.cc:240] Negotiation successful
0805 22:56:55.081690 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":319,"threads_started":1}
I20260805 22:56:55.084389 6978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:55.058198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:46935 (local address 127.20.34.126:33975)
0805 22:56:55.058782 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:55.058788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:55.059939 (+ 1151us) server_negotiation.cc:407] Connection header received
0805 22:56:55.062530 (+ 2591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:55.062538 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:55.062635 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:55.062769 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:55.064773 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.065917 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.068312 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.069065 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.069227 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:55.074134 (+ 4907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:55.074142 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:55.074146 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:55.074191 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:55.077982 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:55.079116 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:55.079121 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:55.079125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:55.079274 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:55.079823 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:55.079828 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:55.079831 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:55.080219 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:55.083552 (+ 3333us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:55.083723 (+ 171us) server_negotiation.cc:299] Negotiation successful
0805 22:56:55.083992 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":275,"threads_started":1}
I20260805 22:56:55.085631 6975 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33975
I20260805 22:56:55.085984 6975 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:55.086872 6975 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
I20260805 22:56:55.088721 6425 ts_manager.cc:194] Registered new tserver with Master: 98fbba65c0b34511b694b0a1a7512b77 (127.20.34.66:46547)
I20260805 22:56:55.090015 6425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:46935
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:56:55.137828 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:38461/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33975
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:56:55.165678 6753 heartbeater.cc:503] Master 127.20.34.126:33975 was elected leader, sending a full tablet report...
W20260805 22:56:55.513501 6984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:55.513825 6984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:55.513927 6984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:55.521530 6984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:55.521660 6984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:55.521782 6984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:56:55.532433 6984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.34.84:38461/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:55.533841 6984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:55.535125 6984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:55.549417 6993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:55.549417 6992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:55.549360 6996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:55.550530 6984 server_base.cc:1034] running on GCE node
I20260805 22:56:55.551266 6984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:55.552342 6984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:55.553576 6984 hybrid_clock.cc:648] HybridClock initialized: now 1785970615553512 us; error 66 us; skew 500 ppm
I20260805 22:56:55.554041 6984 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:55 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970615, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:55.557513 6984 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:56:55.559074 6984 webserver.cc:460] Webserver started at http://127.20.34.67:46467/ using document root <none> and password file <none>
I20260805 22:56:55.559794 6984 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:55.559914 6984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:56:55.560290 6984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 22:56:55 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970615, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:55.578132 6984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "a7161f2b51344e4fa21a4c7f6090eae7"
format_stamp: "Formatted at 2026-08-05 22:56:55 on dist-test-slave-gmjp"
server_key: "ecf8d7a84b07496cf9a5a3220f2e8638"
server_key_iv: "5f8300b9353e774a278a8161ff303b3d"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:55.579406 6984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "a7161f2b51344e4fa21a4c7f6090eae7"
format_stamp: "Formatted at 2026-08-05 22:56:55 on dist-test-slave-gmjp"
server_key: "ecf8d7a84b07496cf9a5a3220f2e8638"
server_key_iv: "5f8300b9353e774a278a8161ff303b3d"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:55.585881 6984 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260805 22:56:55.605155 7008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:55.606874 6984 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 22:56:55.607086 6984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "a7161f2b51344e4fa21a4c7f6090eae7"
format_stamp: "Formatted at 2026-08-05 22:56:55 on dist-test-slave-gmjp"
server_key: "ecf8d7a84b07496cf9a5a3220f2e8638"
server_key_iv: "5f8300b9353e774a278a8161ff303b3d"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:55.607343 6984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:55.623432 6984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:55.627770 6984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:55.628113 6984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:55.629271 6984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:55.631008 6984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:55.631112 6984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:55.631268 6984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:55.631341 6984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:55.675796 6984 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:33767
I20260805 22:56:55.675812 7186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:33767 every 8 connection(s)
I20260805 22:56:55.677284 6984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:56:55.682933 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 6984
I20260805 22:56:55.683125 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:56:55.683799 20617 external_mini_cluster.cc:1428] Setting key c6d2fd82612d6346d38f89082504ac12
Aug 05 22:56:55 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970615, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:55.701265 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:55.680399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:37293 (local address 127.20.34.126:33975)
0805 22:56:55.680966 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:55.680973 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:55.682130 (+ 1157us) server_negotiation.cc:407] Connection header received
0805 22:56:55.684326 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:55.684332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:55.684437 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:55.684563 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:55.686516 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.687608 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.689325 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.690036 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.690177 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:55.694050 (+ 3873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:55.694057 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:55.694063 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:55.694106 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:55.697546 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:55.698531 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:55.698537 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:55.698541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:55.698711 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:55.699276 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:55.699282 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:55.699286 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:55.699666 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:55.699810 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:55.700830 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0805 22:56:55.701015 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":262,"threads_started":1}
I20260805 22:56:55.702730 7197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:55.681080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33975 (local address 127.20.34.67:37293)
0805 22:56:55.681945 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:55.681993 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:55.683987 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:55.684830 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:55.684839 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:55.685519 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:55.686307 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:55.686338 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.687779 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.687783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:55.689164 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:55.689178 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.690268 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.690273 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:55.690574 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:55.691380 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:55.691415 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:55.693784 (+ 2369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:55.697720 (+ 3936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:55.697730 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:55.697749 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:55.698370 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:55.698856 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:55.698862 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:55.698866 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:55.699108 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:55.699902 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:55.699911 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:55.700401 (+ 490us) client_negotiation.cc:769] Sending connection context
0805 22:56:55.700720 (+ 319us) client_negotiation.cc:240] Negotiation successful
0805 22:56:55.701289 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":388,"threads_started":1}
I20260805 22:56:55.704237 7188 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33975
I20260805 22:56:55.704605 7188 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:55.705544 7188 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
I20260805 22:56:55.707266 6425 ts_manager.cc:194] Registered new tserver with Master: a7161f2b51344e4fa21a4c7f6090eae7 (127.20.34.67:33767)
I20260805 22:56:55.708137 6425 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:37293
I20260805 22:56:55.712858 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:56:55.714808 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 6548
Aug 05 22:56:55 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:56:55.741662 7205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:55.715909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43890 (local address 127.20.34.65:43627)
0805 22:56:55.724849 (+ 8940us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:55.724860 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:55.724903 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:56:55.724996 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:55.725007 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:55.725384 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:55.725638 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:55.727473 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.728646 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.730301 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.730904 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.731012 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:55.735633 (+ 4621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:55.735648 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:55.735668 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:55.735709 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:55.738792 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:55.739589 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:55.739599 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:55.739601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:55.739768 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:55.740144 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:55.740212 (+ 68us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:55.740219 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:55.740604 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:55.740865 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:55.741140 (+ 275us) server_negotiation.cc:299] Negotiation successful
0805 22:56:55.741360 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8700,"thread_start_us":8502,"threads_started":1}
I20260805 22:56:55.743224 6747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:56:55.828459 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 6548
I20260805 22:56:55.854835 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 6760
Aug 05 22:56:55 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:56:55.877395 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:55.860741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45024 (local address 127.20.34.66:46547)
0805 22:56:55.861332 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:55.861340 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:55.861370 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:56:55.861444 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:55.861451 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:55.861669 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:55.861836 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:55.863220 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.864304 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.865780 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.866341 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.866444 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:55.871021 (+ 4577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:55.871034 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:55.871051 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:55.871091 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:55.874055 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:55.874894 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:55.874902 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:55.874904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:55.875067 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:55.875507 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:55.875512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:55.875514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:55.875919 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:55.876204 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:55.876767 (+ 563us) server_negotiation.cc:299] Negotiation successful
0805 22:56:55.876998 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":301,"threads_started":1}
I20260805 22:56:55.878937 6967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:56:55.964143 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 6760
I20260805 22:56:55.989142 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 6984
Aug 05 22:56:55 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:56:56.006631 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:55.990385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51952 (local address 127.20.34.67:33767)
0805 22:56:55.991109 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:55.991116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:55.991145 (+ 29us) server_negotiation.cc:407] Connection header received
0805 22:56:55.991207 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:55.991214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:55.991442 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:55.991577 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:55.993117 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.994148 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.995447 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:55.996015 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:55.996109 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:56.000606 (+ 4497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:56.000619 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:56.000636 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:56.000675 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:56.003581 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:56.004442 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:56.004450 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:56.004452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:56.004586 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:56.005023 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:56.005026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:56.005028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:56.005369 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:56.005635 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:56.005993 (+ 358us) server_negotiation.cc:299] Negotiation successful
0805 22:56:56.006206 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":368,"threads_started":1}
I20260805 22:56:56.008086 7182 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:56:56.096561 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 6984
I20260805 22:56:56.118965 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 6381
I20260805 22:56:56.120453 6476 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:56:56.237460 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 6381
I20260805 22:56:56.267078 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:33975
--webserver_interface=127.20.34.126
--webserver_port=40979
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:33975
--ranger_config_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:38461/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.34.84:38461/kms with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:56:56.627688 7214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:56.628038 7214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:56.628134 7214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:56.635782 7214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:56:56.635905 7214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:56.635951 7214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:56.636009 7214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:56:56.636059 7214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:56:56.646939 7214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.34.84:38461/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:33975
--ranger_config_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:33975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=40979
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:56.648365 7214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:56.649761 7214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:56.662573 7228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:56.662519 7230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:56.663133 7225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:56.663597 7214 server_base.cc:1034] running on GCE node
I20260805 22:56:56.664546 7214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:56.666115 7214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:56.667367 7214 hybrid_clock.cc:648] HybridClock initialized: now 1785970616667313 us; error 70 us; skew 500 ppm
I20260805 22:56:56.667762 7214 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:56 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970616, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:56.670928 7214 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:56:56.672627 7214 webserver.cc:460] Webserver started at http://127.20.34.126:40979/ using document root <none> and password file <none>
I20260805 22:56:56.673329 7214 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:56.673487 7214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:56:56 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970616, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:56.726123 7214 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:56:56.729532 7242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:56.731096 7214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:56:56.731304 7214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "3eba381b3fb2405c811a1a58b4f6c78b"
format_stamp: "Formatted at 2026-08-05 22:56:52 on dist-test-slave-gmjp"
server_key: "fc6d650821e57b2944410155124a5b98"
server_key_iv: "57795292d764cd9d975505059b84a989"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:56.732421 7214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:56.778782 7214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:56.783430 7214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:56.783763 7214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:56.804116 7214 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:33975
I20260805 22:56:56.804142 7319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:33975 every 8 connection(s)
I20260805 22:56:56.805796 7214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:56:56.810362 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 7214
I20260805 22:56:56.811370 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:38461/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:43627
--local_ip_for_outbound_sockets=127.20.34.65
--tserver_master_addrs=127.20.34.126:33975
--webserver_port=35739
--webserver_interface=127.20.34.65
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.34.84:38461/kms with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:56:56.813591 7320 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:56:56.817111 7320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Bootstrap starting.
I20260805 22:56:56.837077 7320 log.cc:824] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:56:56.846935 7320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:56:56.847658 7320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Bootstrap complete.
I20260805 22:56:56.857607 7320 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } }
I20260805 22:56:56.858606 7320 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eba381b3fb2405c811a1a58b4f6c78b, State: Initialized, Role: FOLLOWER
I20260805 22:56:56.859301 7320 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } }
I20260805 22:56:56.859582 7320 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:56:56.859730 7320 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:56:56.859929 7320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:56:56.864051 7320 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } }
I20260805 22:56:56.864778 7320 leader_election.cc:302] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3eba381b3fb2405c811a1a58b4f6c78b; no voters:
I20260805 22:56:56.865492 7320 leader_election.cc:288] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:56:56.865649 7324 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:56:56.866961 7324 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [term 2 LEADER]: Becoming Leader. State: Replica: 3eba381b3fb2405c811a1a58b4f6c78b, State: Running, Role: LEADER
I20260805 22:56:56.867573 7324 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } }
I20260805 22:56:56.867959 7320 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:56:56.870428 7329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eba381b3fb2405c811a1a58b4f6c78b. Latest consensus state: current_term: 2 leader_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } } }
I20260805 22:56:56.871345 7329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: This master's current role is: LEADER
I20260805 22:56:56.870981 7326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eba381b3fb2405c811a1a58b4f6c78b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33975 } } }
I20260805 22:56:56.872408 7326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b [sys.catalog]: This master's current role is: LEADER
I20260805 22:56:56.872498 7337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:56:56.889794 7337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:56:56.891755 7337 catalog_manager.cc:1259] Loaded cluster ID: 95c06bb0040d4dc0b3b5a9f159d84004
I20260805 22:56:56.891901 7337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:56:56.897212 7337 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:56:56.899269 7337 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Loaded TSK: 0
I20260805 22:56:56.901222 7337 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:56:56.904012 7320 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260805 22:56:57.311921 7322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:57.312450 7322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:57.312654 7322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:57.324914 7322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:57.325112 7322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:57.325363 7322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:56:57.342375 7322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.34.84:38461/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:43627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=35739
--tserver_master_addrs=127.20.34.126:33975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:57.344349 7322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:57.346359 7322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:57.392709 7381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:57.397214 7380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:57.407650 7385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:57.408351 7322 server_base.cc:1034] running on GCE node
I20260805 22:56:57.409437 7322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:57.418459 7322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:57.419921 7322 hybrid_clock.cc:648] HybridClock initialized: now 1785970617419845 us; error 90 us; skew 500 ppm
I20260805 22:56:57.420403 7322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:57 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970617, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:57.424598 7322 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:56:57.426688 7322 webserver.cc:460] Webserver started at http://127.20.34.65:35739/ using document root <none> and password file <none>
I20260805 22:56:57.427552 7322 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:57.427738 7322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:56:57 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970617, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:57.478296 7322 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.003s sys 0.011s
I20260805 22:56:57.485814 7397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:57.488360 7322 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.004s
I20260805 22:56:57.488718 7322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "438a6188bf5547d38126ed306a5489cd"
format_stamp: "Formatted at 2026-08-05 22:56:53 on dist-test-slave-gmjp"
server_key: "1d485e8e5e4cbb92cce945f868858b4c"
server_key_iv: "6b9255bb78b3b61342d62bc2b02072e6"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:57.490353 7322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:57.523092 7322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:57.528455 7322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:57.528863 7322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:57.531798 7322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:57.534194 7322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:57.534307 7322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:57.534423 7322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:57.534495 7322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:57.579501 7322 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:43627
I20260805 22:56:57.579615 7563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:43627 every 8 connection(s)
I20260805 22:56:57.581624 7322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:56:57.583609 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 7322
I20260805 22:56:57.584515 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:38461/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:46547
--local_ip_for_outbound_sockets=127.20.34.66
--tserver_master_addrs=127.20.34.126:33975
--webserver_port=43331
--webserver_interface=127.20.34.66
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.34.84:38461/kms with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:56:57 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970617, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:57.627775 7566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:57.590729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33975 (local address 127.20.34.65:54393)
0805 22:56:57.597144 (+ 6415us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:57.597203 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:57.600036 (+ 2833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:57.602234 (+ 2198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:57.602251 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:57.602999 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:57.603854 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:57.603904 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:57.606607 (+ 2703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:57.606616 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:57.608963 (+ 2347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:57.608986 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:57.611166 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:57.611177 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:57.611632 (+ 455us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:57.612604 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:57.612642 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:57.615852 (+ 3210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:57.621645 (+ 5793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:57.621659 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:57.621682 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:57.622449 (+ 767us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:57.623169 (+ 720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:57.623177 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:57.623184 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:57.623503 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:57.624908 (+ 1405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:57.624920 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:57.625391 (+ 471us) client_negotiation.cc:769] Sending connection context
0805 22:56:57.625705 (+ 314us) client_negotiation.cc:240] Negotiation successful
0805 22:56:57.626322 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6104,"thread_start_us":5803,"threads_started":1}
I20260805 22:56:57.630406 7569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:57.592063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:54393 (local address 127.20.34.126:33975)
0805 22:56:57.596344 (+ 4281us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:57.596375 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:57.600296 (+ 3921us) server_negotiation.cc:407] Connection header received
0805 22:56:57.600913 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:57.600940 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:57.601518 (+ 578us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:57.602020 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:57.604213 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:57.606368 (+ 2155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:57.609195 (+ 2827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:57.610488 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:57.610699 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:57.616356 (+ 5657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:57.616372 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:57.616402 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:57.616485 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:57.621384 (+ 4899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:57.622703 (+ 1319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:57.622718 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:57.622729 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:57.623001 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:57.623669 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:57.623677 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:57.623683 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:57.624543 (+ 860us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:57.624775 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:57.628531 (+ 3756us) server_negotiation.cc:299] Negotiation successful
0805 22:56:57.629021 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3755,"thread_start_us":3410,"threads_started":1}
I20260805 22:56:57.635165 7564 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33975
I20260805 22:56:57.635530 7564 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:57.636528 7564 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
W20260805 22:56:57.640194 7564 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:33975 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:56:57.640443 7564 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:57.640753 7564 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
I20260805 22:56:57.642379 7564 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:57.642802 7564 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
W20260805 22:56:57.644120 7564 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:56:58.059927 7570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:58.060400 7570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:58.060573 7570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:58.072506 7570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:58.072788 7570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:58.073050 7570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:56:58.089440 7570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.34.84:38461/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:46547
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=43331
--tserver_master_addrs=127.20.34.126:33975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:58.091502 7570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:58.093461 7570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:58.137477 7596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:58.137519 7597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:58.139472 7599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:58.139961 7570 server_base.cc:1034] running on GCE node
I20260805 22:56:58.140798 7570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:58.142132 7570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:58.143397 7570 hybrid_clock.cc:648] HybridClock initialized: now 1785970618143330 us; error 55 us; skew 500 ppm
I20260805 22:56:58.143810 7570 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:58 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:58.152736 7570 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:56:58.155009 7570 webserver.cc:460] Webserver started at http://127.20.34.66:43331/ using document root <none> and password file <none>
I20260805 22:56:58.156028 7570 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:58.156222 7570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:56:58 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
Aug 05 22:56:58 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:58.199565 7570 fs_manager.cc:709] Time spent opening directory manager: real 0.022s user 0.003s sys 0.013s
I20260805 22:56:58.220927 7612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:58.223006 7570 fs_manager.cc:725] Time spent opening block manager: real 0.022s user 0.002s sys 0.019s
I20260805 22:56:58.223326 7570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "98fbba65c0b34511b694b0a1a7512b77"
format_stamp: "Formatted at 2026-08-05 22:56:54 on dist-test-slave-gmjp"
server_key: "ed3a628deb253f5c74dfa50a2431a152"
server_key_iv: "f508b263a92aadf9dec41627def95071"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:58.225018 7570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:58.242620 7570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:58.247713 7570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:58.248070 7570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:58.249308 7570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:58.250984 7570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:58.251113 7570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:58.251266 7570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:58.251363 7570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:58.303913 7570 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:46547
I20260805 22:56:58.303988 7781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:46547 every 8 connection(s)
I20260805 22:56:58.306025 7570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:56:58.315990 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 7570
I20260805 22:56:58.316862 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.34.84:38461/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:33767
--local_ip_for_outbound_sockets=127.20.34.67
--tserver_master_addrs=127.20.34.126:33975
--webserver_port=46467
--webserver_interface=127.20.34.67
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.34.84:38461/kms with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:56:58 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:58.339468 7789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:58.312919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33975 (local address 127.20.34.66:53475)
0805 22:56:58.317376 (+ 4457us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:58.317430 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:58.319579 (+ 2149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:58.320627 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:58.320636 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:58.321135 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:58.321749 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:58.321767 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:58.322930 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:58.322935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:58.324722 (+ 1787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:58.324737 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:58.325652 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:58.325663 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:58.325946 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:58.326740 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:58.326771 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:58.329219 (+ 2448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:58.333818 (+ 4599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:58.333831 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:58.333853 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:58.334544 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:58.335067 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:58.335075 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:58.335081 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:58.335378 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:58.336227 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:58.336238 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:58.336774 (+ 536us) client_negotiation.cc:769] Sending connection context
0805 22:56:58.337097 (+ 323us) client_negotiation.cc:240] Negotiation successful
0805 22:56:58.337767 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3879,"thread_start_us":3605,"threads_started":1}
I20260805 22:56:58.341966 7788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:58.312005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:53475 (local address 127.20.34.126:33975)
0805 22:56:58.316471 (+ 4466us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:58.316481 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:58.317570 (+ 1089us) server_negotiation.cc:407] Connection header received
0805 22:56:58.320053 (+ 2483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:58.320060 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:58.320193 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:58.320325 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:58.321956 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:58.322738 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:58.324909 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:58.325368 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:58.325544 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:58.329538 (+ 3994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:58.329545 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:58.329549 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:58.329587 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:58.333493 (+ 3906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:58.334745 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:58.334766 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:58.334772 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:58.334928 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:58.335562 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:58.335569 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:58.335575 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:58.336041 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:58.340925 (+ 4884us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:58.341135 (+ 210us) server_negotiation.cc:299] Negotiation successful
0805 22:56:58.341452 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4258,"thread_start_us":3980,"threads_started":1}
I20260805 22:56:58.344023 7786 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33975
I20260805 22:56:58.344494 7786 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:58.345585 7786 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
I20260805 22:56:58.348237 7266 ts_manager.cc:194] Registered new tserver with Master: 98fbba65c0b34511b694b0a1a7512b77 (127.20.34.66:46547)
I20260805 22:56:58.350983 7266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:53475
I20260805 22:56:58.644330 7564 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:58.644832 7564 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
I20260805 22:56:58.646661 7266 ts_manager.cc:194] Registered new tserver with Master: 438a6188bf5547d38126ed306a5489cd (127.20.34.65:43627)
I20260805 22:56:58.647893 7266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:54393
Aug 05 22:56:58 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
W20260805 22:56:58.779508 7790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:56:58.779891 7790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:56:58.780061 7790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:56:58.789705 7790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:56:58.789870 7790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:56:58.790103 7790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:56:58.805096 7790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.34.84:38461/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:33767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=46467
--tserver_master_addrs=127.20.34.126:33975
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:56:58.807152 7790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:56:58.809052 7790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:56:58.829066 7797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:56:58.828997 7799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:58.830117 7790 server_base.cc:1034] running on GCE node
W20260805 22:56:58.830516 7801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:56:58.831509 7790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:56:58.836304 7790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:56:58.837594 7790 hybrid_clock.cc:648] HybridClock initialized: now 1785970618837526 us; error 86 us; skew 500 ppm
I20260805 22:56:58.838003 7790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:56:58 dist-test-slave-gmjp krb5kdc[5654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:56:58.842139 7790 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:56:58.848388 7790 webserver.cc:460] Webserver started at http://127.20.34.67:46467/ using document root <none> and password file <none>
I20260805 22:56:58.849246 7790 fs_manager.cc:359] Metadata directory not provided
I20260805 22:56:58.849457 7790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 22:56:58 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
I20260805 22:56:58.890336 7790 fs_manager.cc:709] Time spent opening directory manager: real 0.023s user 0.015s sys 0.006s
I20260805 22:56:58.894125 7815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:58.895874 7790 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 22:56:58.896139 7790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "a7161f2b51344e4fa21a4c7f6090eae7"
format_stamp: "Formatted at 2026-08-05 22:56:55 on dist-test-slave-gmjp"
server_key: "ecf8d7a84b07496cf9a5a3220f2e8638"
server_key_iv: "5f8300b9353e774a278a8161ff303b3d"
server_key_version: "kuduclusterkey@0"
I20260805 22:56:58.897418 7790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:56:58.919981 7790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:56:58.926065 7790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:56:58.926421 7790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:56:58.932016 7790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:56:58.934316 7790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:56:58.934469 7790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:58.934615 7790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:56:58.934715 7790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:56:59.024107 7790 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:33767
I20260805 22:56:59.023849 7978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:33767 every 8 connection(s)
I20260805 22:56:59.026266 7790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:56:59.034086 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 7790
Aug 05 22:56:59 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for HTTP/127.20.34.84@KRBTEST.COM
Aug 05 22:56:59 dist-test-slave-gmjp krb5kdc[5654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970618, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:56:59.085079 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.035759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45722 (local address 127.20.34.126:33975)
0805 22:56:59.058727 (+ 22968us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.058740 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.058770 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:56:59.058840 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.058844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.058933 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.059088 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:59.062872 (+ 3784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.064055 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.070354 (+ 6299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.071117 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.075225 (+ 4108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.075562 (+ 337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:59.075568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:59.075573 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:59.075660 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:59.079601 (+ 3941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:59.080725 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:59.080731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:59.080735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:59.080915 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:59.081463 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:59.081470 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:59.081476 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:59.082220 (+ 744us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:59.084242 (+ 2022us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.084388 (+ 146us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.084630 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":22784,"spinlock_wait_cycles":28032,"thread_start_us":4578,"threads_started":1}
I20260805 22:56:59.088642 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.030896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:39581 (local address 127.20.34.126:33975)
0805 22:56:59.040610 (+ 9714us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.040616 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.060266 (+ 19650us) server_negotiation.cc:407] Connection header received
0805 22:56:59.062746 (+ 2480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.062753 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.062862 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.062980 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:59.070328 (+ 7348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.071661 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.074662 (+ 3001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.075477 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.075562 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.080752 (+ 5190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:59.080759 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:59.080763 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:59.080803 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:59.084648 (+ 3845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:59.085753 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:59.085758 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:59.085762 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:59.085916 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:59.086532 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:59.086537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:59.086540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:59.086914 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:59.087051 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.087999 (+ 948us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.088266 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":9585,"thread_start_us":52544,"threads_started":1}
I20260805 22:56:59.089867 7982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.030219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33975 (local address 127.20.34.67:39581)
0805 22:56:59.060024 (+ 29805us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:59.060099 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:59.062346 (+ 2247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:59.063559 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:59.063573 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:59.069332 (+ 5759us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:56:59.070045 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.070067 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.072045 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.072051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.074440 (+ 2389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.074465 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.076041 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.076049 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.076466 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.077273 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:56:59.077312 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:56:59.080385 (+ 3073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:56:59.084828 (+ 4443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:59.084838 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:59.084860 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:59.085605 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:59.086085 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:56:59.086090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:56:59.086093 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:56:59.086387 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:56:59.087142 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:56:59.087148 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:56:59.087498 (+ 350us) client_negotiation.cc:769] Sending connection context
0805 22:56:59.087786 (+ 288us) client_negotiation.cc:240] Negotiation successful
0805 22:56:59.088419 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29344,"thread_start_us":55523,"threads_started":1}
I20260805 22:56:59.092123 7979 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33975
I20260805 22:56:59.092445 7979 heartbeater.cc:464] Registering TS with master...
I20260805 22:56:59.093367 7979 heartbeater.cc:511] Master 127.20.34.126:33975 requested a full tablet report, sending...
I20260805 22:56:59.095290 7266 ts_manager.cc:194] Registered new tserver with Master: a7161f2b51344e4fa21a4c7f6090eae7 (127.20.34.67:33767)
I20260805 22:56:59.096441 7266 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:39581
I20260805 22:56:59.101244 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:56:59.155323 7985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.125636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45734 (local address 127.20.34.126:33975)
0805 22:56:59.125830 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.125839 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.136660 (+ 10821us) server_negotiation.cc:407] Connection header received
0805 22:56:59.137348 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.137355 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.137446 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.137520 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:59.139852 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.141022 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.143108 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.143788 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.143901 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.147879 (+ 3978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:59.147887 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:59.147892 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:59.147943 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:59.151735 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:59.152801 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:59.152807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:59.152811 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:59.152975 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:59.153503 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:59.153508 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:59.153512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:59.153894 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:59.154137 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.154727 (+ 590us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.154975 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:56:59.163036 7266 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45734:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:56:59.174679 7266 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:56:59.222116 8002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.209452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:46547 (local address 127.0.0.1:45034)
0805 22:56:59.212342 (+ 2890us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:59.212363 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:59.212532 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:59.213666 (+ 1134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:59.213674 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:59.213706 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:59.214112 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.214125 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.216178 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.216184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.218675 (+ 2491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.218693 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.221018 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.221024 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.221249 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.221323 (+ 74us) client_negotiation.cc:769] Sending connection context
0805 22:56:59.221453 (+ 130us) client_negotiation.cc:240] Negotiation successful
0805 22:56:59.221662 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2758,"thread_start_us":3321,"threads_started":1}
I20260805 22:56:59.223323 8003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.209798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45034 (local address 127.20.34.66:46547)
0805 22:56:59.211899 (+ 2101us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.211909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.212741 (+ 832us) server_negotiation.cc:407] Connection header received
0805 22:56:59.212859 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.212868 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.213154 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.213373 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:59.214319 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.215983 (+ 1664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.218895 (+ 2912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.220470 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.220620 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.220856 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.222789 (+ 1933us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.222990 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1937,"thread_start_us":1801,"threads_started":1}
I20260805 22:56:59.231000 8000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.203448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:33767 (local address 127.0.0.1:51956)
0805 22:56:59.208931 (+ 5483us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:59.208989 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:59.220549 (+ 11560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:59.221691 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:59.221696 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:59.221723 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:59.222159 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.222174 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.225527 (+ 3353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.225534 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.227849 (+ 2315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.227863 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.230044 (+ 2181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.230050 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.230227 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.230265 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 22:56:59.230344 (+ 79us) client_negotiation.cc:240] Negotiation successful
0805 22:56:59.230497 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5054,"mutex_wait_us":78,"thread_start_us":4877,"threads_started":1}
I20260805 22:56:59.232772 8002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.216683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43896)
0805 22:56:59.224018 (+ 7335us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:59.224041 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:59.224193 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:59.225244 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:59.225248 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:59.225273 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:59.225456 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.225471 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.227612 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.227619 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.229563 (+ 1944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.229579 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.231542 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.231548 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.231882 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.232067 (+ 185us) client_negotiation.cc:769] Sending connection context
0805 22:56:59.232217 (+ 150us) client_negotiation.cc:240] Negotiation successful
0805 22:56:59.232378 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7225,"mutex_wait_us":24,"thread_start_us":11252,"threads_started":1}
I20260805 22:56:59.232800 8001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.204146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51956 (local address 127.20.34.67:33767)
0805 22:56:59.208398 (+ 4252us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.208410 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.220704 (+ 12294us) server_negotiation.cc:407] Connection header received
0805 22:56:59.220834 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.220842 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.221158 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.221378 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:59.222403 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.224018 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.228054 (+ 4036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.229793 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.231496 (+ 1703us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.232076 (+ 580us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.232200 (+ 124us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.232404 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3935,"thread_start_us":3751,"threads_started":1}
I20260805 22:56:59.234262 8004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.213566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43896 (local address 127.20.34.65:43627)
0805 22:56:59.224682 (+ 11116us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.224691 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.224716 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:56:59.224806 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.224812 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.225014 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.225243 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:59.225661 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.227391 (+ 1730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.229802 (+ 2411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.231352 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.233359 (+ 2007us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.233622 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.233702 (+ 80us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.233867 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10910,"thread_start_us":10709,"threads_started":1}
I20260805 22:56:59.233914 7681 tablet_service.cc:1467] Processing CreateTablet for tablet c76190a6d9c04c4691fad3914b10ef29 (DEFAULT_TABLE table=test-table [id=c31c8be1c6d143b69b541a3f4ceb96c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:56:59.236040 7681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c76190a6d9c04c4691fad3914b10ef29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:56:59.246014 7466 tablet_service.cc:1467] Processing CreateTablet for tablet c76190a6d9c04c4691fad3914b10ef29 (DEFAULT_TABLE table=test-table [id=c31c8be1c6d143b69b541a3f4ceb96c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:56:59.248507 7466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c76190a6d9c04c4691fad3914b10ef29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:56:59.250953 7879 tablet_service.cc:1467] Processing CreateTablet for tablet c76190a6d9c04c4691fad3914b10ef29 (DEFAULT_TABLE table=test-table [id=c31c8be1c6d143b69b541a3f4ceb96c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:56:59.252624 7879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c76190a6d9c04c4691fad3914b10ef29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:56:59.265794 8006 tablet_bootstrap.cc:492] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Bootstrap starting.
I20260805 22:56:59.279223 8009 tablet_bootstrap.cc:492] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: Bootstrap starting.
I20260805 22:56:59.280740 8006 tablet_bootstrap.cc:654] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Neither blocks nor log segments found. Creating new log.
I20260805 22:56:59.282544 8006 log.cc:824] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Log is configured to *not* fsync() on all Append() calls
I20260805 22:56:59.285555 8009 tablet_bootstrap.cc:654] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: Neither blocks nor log segments found. Creating new log.
I20260805 22:56:59.287191 8009 log.cc:824] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: Log is configured to *not* fsync() on all Append() calls
I20260805 22:56:59.290230 8014 tablet_bootstrap.cc:492] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Bootstrap starting.
I20260805 22:56:59.295466 8006 tablet_bootstrap.cc:492] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: No bootstrap required, opened a new log
I20260805 22:56:59.295830 8006 ts_tablet_manager.cc:1397] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.000s
I20260805 22:56:59.297595 8009 tablet_bootstrap.cc:492] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: No bootstrap required, opened a new log
I20260805 22:56:59.298007 8009 ts_tablet_manager.cc:1397] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.000s
I20260805 22:56:59.305917 8014 tablet_bootstrap.cc:654] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Neither blocks nor log segments found. Creating new log.
I20260805 22:56:59.313771 8009 raft_consensus.cc:348] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.317130 8006 raft_consensus.cc:348] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.317770 8006 raft_consensus.cc:374] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:56:59.315884 8014 log.cc:824] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:56:59.317955 8006 raft_consensus.cc:729] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98fbba65c0b34511b694b0a1a7512b77, State: Initialized, Role: FOLLOWER
I20260805 22:56:59.319815 8009 raft_consensus.cc:374] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:56:59.320262 8009 raft_consensus.cc:729] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 438a6188bf5547d38126ed306a5489cd, State: Initialized, Role: FOLLOWER
I20260805 22:56:59.321202 8009 consensus_queue.cc:260] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.323060 8006 consensus_queue.cc:260] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.325060 7786 heartbeater.cc:503] Master 127.20.34.126:33975 was elected leader, sending a full tablet report...
I20260805 22:56:59.330014 8009 ts_tablet_manager.cc:1428] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: Time spent starting tablet: real 0.032s user 0.016s sys 0.000s
I20260805 22:56:59.330158 7564 heartbeater.cc:503] Master 127.20.34.126:33975 was elected leader, sending a full tablet report...
I20260805 22:56:59.330365 8014 tablet_bootstrap.cc:492] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: No bootstrap required, opened a new log
I20260805 22:56:59.330773 8014 ts_tablet_manager.cc:1397] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.008s
I20260805 22:56:59.332472 8006 ts_tablet_manager.cc:1428] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Time spent starting tablet: real 0.037s user 0.009s sys 0.008s
W20260805 22:56:59.334494 7565 tablet.cc:2369] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:56:59.344719 8014 raft_consensus.cc:348] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.345340 8014 raft_consensus.cc:374] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:56:59.345474 8014 raft_consensus.cc:729] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7161f2b51344e4fa21a4c7f6090eae7, State: Initialized, Role: FOLLOWER
I20260805 22:56:59.346323 8014 consensus_queue.cc:260] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.347608 7979 heartbeater.cc:503] Master 127.20.34.126:33975 was elected leader, sending a full tablet report...
I20260805 22:56:59.348471 8014 ts_tablet_manager.cc:1428] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Time spent starting tablet: real 0.018s user 0.005s sys 0.009s
W20260805 22:56:59.567442 7980 tablet.cc:2369] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:56:59.572943 7787 tablet.cc:2369] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:56:59.753579 8021 raft_consensus.cc:482] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:56:59.753844 8021 raft_consensus.cc:504] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.755483 8021 leader_election.cc:288] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7161f2b51344e4fa21a4c7f6090eae7 (127.20.34.67:33767), 98fbba65c0b34511b694b0a1a7512b77 (127.20.34.66:46547)
I20260805 22:56:59.762072 8040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.755972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:46753 (local address 127.20.34.67:33767)
0805 22:56:59.756604 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.756612 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.756635 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:56:59.756875 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.756879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.756940 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.757069 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:59.757747 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.758502 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.760305 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.761097 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.761276 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.761356 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.761648 (+ 292us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.761784 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":308,"threads_started":1}
I20260805 22:56:59.762130 8039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.755825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:33767 (local address 127.20.34.65:46753)
0805 22:56:59.756498 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:59.756517 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:59.756690 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:59.757093 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:59.757097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:59.757128 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:59.757555 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.757571 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.758675 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.758679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.760098 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.760110 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.761269 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.761275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.761483 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.761507 (+ 24us) client_negotiation.cc:769] Sending connection context
0805 22:56:59.761611 (+ 104us) client_negotiation.cc:240] Negotiation successful
0805 22:56:59.761745 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":25,"thread_start_us":290,"threads_started":1}
I20260805 22:56:59.763067 7912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76190a6d9c04c4691fad3914b10ef29" candidate_uuid: "438a6188bf5547d38126ed306a5489cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" is_pre_election: true
I20260805 22:56:59.763682 8041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.756688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:46547 (local address 127.20.34.65:49655)
0805 22:56:59.757965 (+ 1277us) negotiation.cc:107] Waiting for socket to connect
0805 22:56:59.757980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:56:59.758145 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:56:59.758521 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:56:59.758525 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:56:59.758553 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:56:59.758979 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.758988 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.760107 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.760111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.761490 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:56:59.761502 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.762837 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.762842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:56:59.762997 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.763019 (+ 22us) client_negotiation.cc:769] Sending connection context
0805 22:56:59.763125 (+ 106us) client_negotiation.cc:240] Negotiation successful
0805 22:56:59.763250 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1181,"mutex_wait_us":73,"thread_start_us":929,"threads_started":1}
I20260805 22:56:59.763677 8042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.756926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:49655 (local address 127.20.34.66:46547)
0805 22:56:59.757642 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.757650 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.758079 (+ 429us) server_negotiation.cc:407] Connection header received
0805 22:56:59.758295 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.758299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.758359 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.758501 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:56:59.759128 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.759934 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.761641 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.762630 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.762808 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.762882 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.763163 (+ 281us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.763350 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":399,"threads_started":1}
I20260805 22:56:59.763653 7912 raft_consensus.cc:2454] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 438a6188bf5547d38126ed306a5489cd in term 0.
I20260805 22:56:59.764451 7403 leader_election.cc:302] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 438a6188bf5547d38126ed306a5489cd, a7161f2b51344e4fa21a4c7f6090eae7; no voters:
I20260805 22:56:59.764707 7705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76190a6d9c04c4691fad3914b10ef29" candidate_uuid: "438a6188bf5547d38126ed306a5489cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98fbba65c0b34511b694b0a1a7512b77" is_pre_election: true
I20260805 22:56:59.764935 8021 raft_consensus.cc:2781] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:56:59.765089 8021 raft_consensus.cc:482] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:56:59.765208 8021 raft_consensus.cc:3037] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:56:59.765304 7705 raft_consensus.cc:2454] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 438a6188bf5547d38126ed306a5489cd in term 0.
I20260805 22:56:59.767562 8021 raft_consensus.cc:504] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.768383 8021 leader_election.cc:288] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [CANDIDATE]: Term 1 election: Requested vote from peers a7161f2b51344e4fa21a4c7f6090eae7 (127.20.34.67:33767), 98fbba65c0b34511b694b0a1a7512b77 (127.20.34.66:46547)
I20260805 22:56:59.768940 7705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76190a6d9c04c4691fad3914b10ef29" candidate_uuid: "438a6188bf5547d38126ed306a5489cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98fbba65c0b34511b694b0a1a7512b77"
I20260805 22:56:59.768975 7912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76190a6d9c04c4691fad3914b10ef29" candidate_uuid: "438a6188bf5547d38126ed306a5489cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7161f2b51344e4fa21a4c7f6090eae7"
I20260805 22:56:59.769191 7705 raft_consensus.cc:3037] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:56:59.769228 7912 raft_consensus.cc:3037] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:56:59.771461 7705 raft_consensus.cc:2454] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 438a6188bf5547d38126ed306a5489cd in term 1.
I20260805 22:56:59.771478 7912 raft_consensus.cc:2454] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 438a6188bf5547d38126ed306a5489cd in term 1.
I20260805 22:56:59.771917 7403 leader_election.cc:302] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 438a6188bf5547d38126ed306a5489cd, 98fbba65c0b34511b694b0a1a7512b77; no voters:
I20260805 22:56:59.772382 8021 raft_consensus.cc:2781] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:56:59.772828 8021 raft_consensus.cc:686] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 1 LEADER]: Becoming Leader. State: Replica: 438a6188bf5547d38126ed306a5489cd, State: Running, Role: LEADER
I20260805 22:56:59.773504 8021 consensus_queue.cc:237] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } }
I20260805 22:56:59.779038 7266 catalog_manager.cc:5495] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 438a6188bf5547d38126ed306a5489cd (127.20.34.65). New cstate: current_term: 1 leader_uuid: "438a6188bf5547d38126ed306a5489cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "438a6188bf5547d38126ed306a5489cd" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 43627 } health_report { overall_health: HEALTHY } } }
I20260805 22:56:59.834306 8052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.827588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43908 (local address 127.20.34.65:43627)
0805 22:56:59.828462 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.828466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.828487 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:56:59.828576 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.828580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.828656 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.828794 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:56:59.829286 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.830072 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.831627 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.832114 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.832266 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.832795 (+ 529us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:56:59.833350 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:56:59.833466 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.833569 (+ 103us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.833637 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":635,"threads_started":1}
I20260805 22:56:59.843200 7912 raft_consensus.cc:1261] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 1 FOLLOWER]: Refusing update from remote peer 438a6188bf5547d38126ed306a5489cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:56:59.843200 7705 raft_consensus.cc:1261] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 1 FOLLOWER]: Refusing update from remote peer 438a6188bf5547d38126ed306a5489cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:56:59.844318 8043 consensus_queue.cc:1035] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "98fbba65c0b34511b694b0a1a7512b77" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:56:59.844763 8021 consensus_queue.cc:1035] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7161f2b51344e4fa21a4c7f6090eae7" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 33767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:56:59.858172 8055 mvcc.cc:205] Tried to move back new op lower bound from 7315335658865594368 to 7315335658596720640. Current Snapshot: MvccSnapshot[applied={T|T < 7315335658865594368}]
I20260805 22:56:59.881448 7266 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:56:59.881767 7266 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:56:59.885885 7266 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3eba381b3fb2405c811a1a58b4f6c78b: Sending DeleteTablet for 3 replicas of tablet c76190a6d9c04c4691fad3914b10ef29
I20260805 22:56:59.887473 7681 tablet_service.cc:1514] Processing DeleteTablet for tablet c76190a6d9c04c4691fad3914b10ef29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:56:59 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:45034
I20260805 22:56:59.887642 7879 tablet_service.cc:1514] Processing DeleteTablet for tablet c76190a6d9c04c4691fad3914b10ef29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:56:59 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:51956
I20260805 22:56:59.890133 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 7322
I20260805 22:56:59.892700 7466 tablet_service.cc:1514] Processing DeleteTablet for tablet c76190a6d9c04c4691fad3914b10ef29 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:56:59 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:43896
I20260805 22:56:59.894476 8071 tablet_replica.cc:330] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: stopping tablet replica
I20260805 22:56:59.895100 8071 raft_consensus.cc:2229] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:56:59.895638 8072 tablet_replica.cc:330] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: stopping tablet replica
I20260805 22:56:59.896145 8072 raft_consensus.cc:2229] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:56:59.896878 8072 raft_consensus.cc:2258] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:56:59.897627 8071 raft_consensus.cc:2258] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:56:59.900383 8072 ts_tablet_manager.cc:1905] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:56:59.903916 8071 ts_tablet_manager.cc:1905] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:56:59.909621 8074 tablet_replica.cc:330] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: stopping tablet replica
I20260805 22:56:59.912374 8074 raft_consensus.cc:2229] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:56:59.913262 8074 raft_consensus.cc:2258] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:56:59.915935 8072 ts_tablet_manager.cc:1918] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:56:59.916210 8072 log.cc:1196] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/c76190a6d9c04c4691fad3914b10ef29
I20260805 22:56:59.916781 8072 ts_tablet_manager.cc:1939] T c76190a6d9c04c4691fad3914b10ef29 P a7161f2b51344e4fa21a4c7f6090eae7: Deleting consensus metadata
I20260805 22:56:59.918823 8074 ts_tablet_manager.cc:1905] T c76190a6d9c04c4691fad3914b10ef29 P 438a6188bf5547d38126ed306a5489cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:56:59.919138 7250 catalog_manager.cc:4841] TS a7161f2b51344e4fa21a4c7f6090eae7 (127.20.34.67:33767): tablet c76190a6d9c04c4691fad3914b10ef29 (table test-table [id=c31c8be1c6d143b69b541a3f4ceb96c8]) successfully deleted
I20260805 22:56:59.919965 8071 ts_tablet_manager.cc:1918] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:56:59.920217 8071 log.cc:1196] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/c76190a6d9c04c4691fad3914b10ef29
I20260805 22:56:59.920673 8071 ts_tablet_manager.cc:1939] T c76190a6d9c04c4691fad3914b10ef29 P 98fbba65c0b34511b694b0a1a7512b77: Deleting consensus metadata
I20260805 22:56:59.922345 7250 catalog_manager.cc:4841] TS 98fbba65c0b34511b694b0a1a7512b77 (127.20.34.66:46547): tablet c76190a6d9c04c4691fad3914b10ef29 (table test-table [id=c31c8be1c6d143b69b541a3f4ceb96c8]) successfully deleted
I20260805 22:56:59.924785 8052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:56:59.892082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43910 (local address 127.20.34.65:43627)
0805 22:56:59.892346 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0805 22:56:59.892355 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:56:59.902442 (+ 10087us) server_negotiation.cc:407] Connection header received
0805 22:56:59.902911 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:56:59.902921 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:56:59.903058 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:56:59.903211 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:56:59.905300 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.906874 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.908955 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:56:59.909770 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:56:59.909904 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:56:59.915325 (+ 5421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:56:59.915341 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:56:59.915361 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:56:59.915443 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:56:59.919981 (+ 4538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:59.921034 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:59.921043 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:59.921046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:59.921252 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:56:59.922910 (+ 1658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:56:59.922916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:56:59.922921 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:56:59.923308 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:56:59.923672 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0805 22:56:59.924053 (+ 381us) server_negotiation.cc:299] Negotiation successful
0805 22:56:59.924386 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260805 22:56:59.925630 7556 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:00.028335 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 7322
I20260805 22:57:00.052030 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 7570
W20260805 22:57:00.051939 7250 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.34.65:43627 (error 108)
I20260805 22:57:00.054378 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.053327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43912)
0805 22:57:00.053862 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:00.054047 (+ 185us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":246,"threads_started":1}
W20260805 22:57:00.054631 7250 catalog_manager.cc:4584] TS 438a6188bf5547d38126ed306a5489cd (127.20.34.65:43627): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c76190a6d9c04c4691fad3914b10ef29: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
I20260805 22:57:00.066084 8042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.052978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45036 (local address 127.20.34.66:46547)
0805 22:57:00.053168 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:00.053176 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:00.053197 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:57:00.053447 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:00.053452 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:00.053571 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:00.053687 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:00.055339 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:00.056075 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:00.057424 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:00.057800 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:00.057899 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:00.060529 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:00.060544 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:00.060560 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:00.060596 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:00.063363 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:00.064212 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:00.064226 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:00.064228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:00.064367 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:00.064792 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:00.064795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:00.064797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:00.065129 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:00.065357 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:00.065657 (+ 300us) server_negotiation.cc:299] Negotiation successful
0805 22:57:00.065836 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 22:57:00.066890 7773 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:00.108304 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.107724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43924)
0805 22:57:00.107978 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:00.108082 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260805 22:57:00.109541 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.109128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43932)
0805 22:57:00.109303 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:00.109388 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260805 22:57:00.162075 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 7570
I20260805 22:57:00.170712 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.170148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43948)
0805 22:57:00.170398 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:00.170515 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260805 22:57:00.172211 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.171731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43960)
0805 22:57:00.171918 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:00.172006 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260805 22:57:00.187634 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 7790
I20260805 22:57:00.202463 8040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.188588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51970 (local address 127.20.34.67:33767)
0805 22:57:00.188863 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:00.188869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:00.188894 (+ 25us) server_negotiation.cc:407] Connection header received
0805 22:57:00.189043 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:00.189048 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:00.189117 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:00.189230 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:00.190675 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:00.191401 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:00.192912 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:00.193332 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:00.193479 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:00.196352 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:00.196368 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:00.196386 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:00.196434 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:00.199330 (+ 2896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:00.200124 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:00.200132 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:00.200134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:00.200345 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:00.200751 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:00.200763 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:00.200767 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:00.201145 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:00.201475 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:00.201851 (+ 376us) server_negotiation.cc:299] Negotiation successful
0805 22:57:00.202116 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 22:57:00.203218 7971 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:00.252971 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.252417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43976)
0805 22:57:00.252671 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:00.252809 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260805 22:57:00.254124 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.253711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43988)
0805 22:57:00.253920 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:00.253989 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260805 22:57:00.296672 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 7790
I20260805 22:57:00.317035 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 7214
I20260805 22:57:00.318363 7314 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:00.434321 8080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:00.433501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:43627 (local address 127.0.0.1:43996)
0805 22:57:00.433903 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:00.434086 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:43627: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260805 22:57:00.434536 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 7214
I20260805 22:57:00.469787 20617 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260805 22:57:00.816411 20617 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260805 22:57:00.816663 20617 mini_ranger.cc:66] Stopping Ranger...
I20260805 22:57:01.173594 20617 mini_ranger.cc:68] Stopped Ranger
2026-08-05 22:57:01.173 UTC [5701] LOG: received smart shutdown request
2026-08-05 22:57:01.177 UTC [5701] LOG: background worker "logical replication launcher" (PID 5714) exited with exit code 1
2026-08-05 22:57:01.177 UTC [5708] LOG: shutting down
2026-08-05 22:57:01.355 UTC [5701] LOG: database system is shut down
2026-08-05T22:57:01Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (57319 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:57:01 dist-test-slave-gmjp krb5kdc[8098](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:57:01 dist-test-slave-gmjp krb5kdc[8098](info): set up 2 sockets
Aug 05 22:57:01 dist-test-slave-gmjp krb5kdc[8098](info): commencing operation
krb5kdc: starting...
W20260805 22:57:02.816130 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:57:03 dist-test-slave-gmjp krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:57:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:57:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:57:03.143573 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:37429
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:37429,127.20.34.125:42725,127.20.34.124:38765
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:03.521474 8122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:03.521771 8122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:03.521976 8122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:03.530149 8122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:03.530292 8122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:03.530383 8122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:03.530507 8122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:03.530573 8122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:03.540987 8122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:37429,127.20.34.125:42725,127.20.34.124:38765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:37429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:03.542519 8122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:03.544042 8122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:03.556423 8128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:03.556427 8133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:03.556457 8129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:03.557616 8122 server_base.cc:1034] running on GCE node
I20260805 22:57:03.558585 8122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:03.560233 8122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:03.561483 8122 hybrid_clock.cc:648] HybridClock initialized: now 1785970623561441 us; error 43 us; skew 500 ppm
I20260805 22:57:03.561869 8122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:03 dist-test-slave-gmjp krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970623, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:03.568286 8122 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:57:03.569954 8122 webserver.cc:460] Webserver started at http://127.20.34.126:33385/ using document root <none> and password file <none>
I20260805 22:57:03.570709 8122 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:03.570868 8122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:03.571195 8122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:03.574451 8122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "65ed93ed915b43898a35b872c605f01f"
format_stamp: "Formatted at 2026-08-05 22:57:03 on dist-test-slave-gmjp"
server_key: "5f5d5bb948476e303044cd77808a7387"
server_key_iv: "3f24845557142aaa676cba4dce03b103"
server_key_version: "encryptionkey@0"
I20260805 22:57:03.575345 8122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "65ed93ed915b43898a35b872c605f01f"
format_stamp: "Formatted at 2026-08-05 22:57:03 on dist-test-slave-gmjp"
server_key: "5f5d5bb948476e303044cd77808a7387"
server_key_iv: "3f24845557142aaa676cba4dce03b103"
server_key_version: "encryptionkey@0"
I20260805 22:57:03.580940 8122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260805 22:57:03.584638 8146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:03.585987 8122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:57:03.586182 8122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "65ed93ed915b43898a35b872c605f01f"
format_stamp: "Formatted at 2026-08-05 22:57:03 on dist-test-slave-gmjp"
server_key: "5f5d5bb948476e303044cd77808a7387"
server_key_iv: "3f24845557142aaa676cba4dce03b103"
server_key_version: "encryptionkey@0"
I20260805 22:57:03.586391 8122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:03.610849 8122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:03.615191 8122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:03.615522 8122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:03.635051 8122 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:37429
I20260805 22:57:03.635090 8222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:37429 every 8 connection(s)
I20260805 22:57:03.636556 8122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:57:03.639982 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 8122
I20260805 22:57:03.640273 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:57:03.640885 8223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:03.641211 20617 external_mini_cluster.cc:1428] Setting key 75777193626d441a1a6ee75daaa059ad
I20260805 22:57:03.651818 8223 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:57:03 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970623, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.34.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.125@KRBTEST.COM" created.
I20260805 22:57:03.677462 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.656292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:37429 (local address 127.0.0.1:60322)
0805 22:57:03.657545 (+ 1253us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.657590 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:03.659516 (+ 1926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:03.660541 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:03.660548 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:03.661316 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:03.661689 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:03.661707 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:03.663343 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:03.663347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:03.664656 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:03.664670 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:03.665637 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:03.665644 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:03.665889 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:03.666609 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:03.666638 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:03.669230 (+ 2592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:03.672731 (+ 3501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:03.672747 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:03.672760 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:03.673172 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:03.673672 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:03.673678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:03.673682 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:03.673908 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:03.674794 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:03.674802 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:03.675054 (+ 252us) client_negotiation.cc:769] Sending connection context
0805 22:57:03.675308 (+ 254us) client_negotiation.cc:240] Negotiation successful
0805 22:57:03.675999 (+ 691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1026,"mutex_wait_us":175,"thread_start_us":799,"threads_started":1}
I20260805 22:57:03.677503 8228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.656291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60322 (local address 127.20.34.126:37429)
0805 22:57:03.657256 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:03.657279 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:03.657726 (+ 447us) server_negotiation.cc:407] Connection header received
0805 22:57:03.659969 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:03.659976 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:03.660300 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:03.660530 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:03.661908 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:03.663163 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:03.664805 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:03.665382 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:03.665602 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:03.669524 (+ 3922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:03.669534 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:03.669548 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:03.669582 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:03.672580 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:03.673387 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:03.673400 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:03.673403 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:03.673556 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:03.674030 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:03.674037 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:03.674045 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:03.674654 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:03.674862 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:03.675468 (+ 606us) server_negotiation.cc:299] Negotiation successful
0805 22:57:03.675873 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":110,"server-negotiator.queue_time_us":683,"thread_start_us":432,"threads_started":1}
I20260805 22:57:03.681160 8223 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:57:03.682435 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.682032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35338)
0805 22:57:03.682207 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.682310 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260805 22:57:03.682801 8148 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
I20260805 22:57:03.684587 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.684087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35350)
0805 22:57:03.684294 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.684390 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 22:57:03.684801 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:42725: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab.
Entry for principal kudu/127.20.34.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab.
I20260805 22:57:03.711997 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.125:42725
--webserver_interface=127.20.34.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab
--principal=kudu/127.20.34.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:37429,127.20.34.125:42725,127.20.34.124:38765
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:57:03.734201 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } attempt: 1
I20260805 22:57:03.735446 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.734950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35360)
0805 22:57:03.735163 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.735298 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260805 22:57:03.737529 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.736988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35376)
0805 22:57:03.737204 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.737313 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260805 22:57:03.737777 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:42725: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
I20260805 22:57:03.806113 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } attempt: 2
I20260805 22:57:03.807530 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.806903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35392)
0805 22:57:03.807200 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.807320 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260805 22:57:03.808851 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.808385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35406)
0805 22:57:03.808579 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.808676 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260805 22:57:03.809101 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:42725: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
I20260805 22:57:03.900405 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } attempt: 3
I20260805 22:57:03.901744 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.901162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35414)
0805 22:57:03.901441 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.901572 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260805 22:57:03.902933 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:03.902442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35420)
0805 22:57:03.902629 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:03.902729 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260805 22:57:03.903165 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:42725: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
I20260805 22:57:04.046478 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } attempt: 4
I20260805 22:57:04.047953 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.047254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35430)
0805 22:57:04.047653 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.047774 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207}
I20260805 22:57:04.049134 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.048712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35442)
0805 22:57:04.048872 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.048986 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260805 22:57:04.049372 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:42725: Network error: Client connection negotiation failed: client connection to 127.20.34.125:42725: connect: Connection refused (error 111)
W20260805 22:57:04.076515 8232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:04.076828 8232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:04.076932 8232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:04.085014 8232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:04.085173 8232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:04.085318 8232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:04.085414 8232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:04.085481 8232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:04.096851 8232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:37429,127.20.34.125:42725,127.20.34.124:38765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab
--principal=kudu/127.20.34.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.125:42725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.34.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:04.098237 8232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:04.099558 8232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:04.112275 8245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:04.112318 8243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:04.112224 8242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:04.113447 8232 server_base.cc:1034] running on GCE node
I20260805 22:57:04.114320 8232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:04.115921 8232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:04.117163 8232 hybrid_clock.cc:648] HybridClock initialized: now 1785970624117107 us; error 55 us; skew 500 ppm
I20260805 22:57:04.117542 8232 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:04.121014 8232 init.cc:377] Logged in from keytab as kudu/127.20.34.125@KRBTEST.COM (short username kudu)
I20260805 22:57:04.122690 8232 webserver.cc:460] Webserver started at http://127.20.34.125:40291/ using document root <none> and password file <none>
I20260805 22:57:04.123454 8232 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:04.123606 8232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:04.123947 8232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:04.127373 8232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/data/instance:
uuid: "9c2502b42dd94493abf279daa49d002a"
format_stamp: "Formatted at 2026-08-05 22:57:04 on dist-test-slave-gmjp"
server_key: "ba70a2858622b3805d75511fe1442ba7"
server_key_iv: "bf81e83dad30f308ab8aeeb891a00f8e"
server_key_version: "encryptionkey@0"
I20260805 22:57:04.128345 8232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/wal/instance:
uuid: "9c2502b42dd94493abf279daa49d002a"
format_stamp: "Formatted at 2026-08-05 22:57:04 on dist-test-slave-gmjp"
server_key: "ba70a2858622b3805d75511fe1442ba7"
server_key_iv: "bf81e83dad30f308ab8aeeb891a00f8e"
server_key_version: "encryptionkey@0"
I20260805 22:57:04.133848 8232 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:57:04.137424 8256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:04.138788 8232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:57:04.138988 8232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/wal
uuid: "9c2502b42dd94493abf279daa49d002a"
format_stamp: "Formatted at 2026-08-05 22:57:04 on dist-test-slave-gmjp"
server_key: "ba70a2858622b3805d75511fe1442ba7"
server_key_iv: "bf81e83dad30f308ab8aeeb891a00f8e"
server_key_version: "encryptionkey@0"
I20260805 22:57:04.139190 8232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:04.155452 8232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:04.159864 8232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:04.160280 8232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:04.180305 8232 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.125:42725
I20260805 22:57:04.180335 8333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.125:42725 every 8 connection(s)
I20260805 22:57:04.181921 8232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
I20260805 22:57:04.184283 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 8232
I20260805 22:57:04.184517 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-1/wal/instance
I20260805 22:57:04.185135 20617 external_mini_cluster.cc:1428] Setting key 905a88afac0899aa775f7b35cb6e018d
I20260805 22:57:04.186499 8335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:04.197760 8335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.34.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.124@KRBTEST.COM" created.
I20260805 22:57:04.221095 8338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.201409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60334 (local address 127.20.34.126:37429)
0805 22:57:04.201989 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.201994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.203209 (+ 1215us) server_negotiation.cc:407] Connection header received
0805 22:57:04.205342 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.205347 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.205451 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.205583 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.207314 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.208077 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.209803 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.210246 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.210403 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.214358 (+ 3955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.214364 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.214368 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.214417 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.217508 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.218423 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.218428 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.218430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.218570 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.219095 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.219099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.219101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.219431 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.219628 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.220443 (+ 815us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.220680 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":314,"threads_started":1}
I20260805 22:57:04.222150 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.202106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:37429 (local address 127.0.0.1:60334)
0805 22:57:04.203001 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.203054 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:04.205037 (+ 1983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:04.205857 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:04.205867 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:04.206435 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:04.207101 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.207122 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.208299 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.208303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.209623 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.209637 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.210509 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.210516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.210770 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.211541 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:04.211584 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:04.214081 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:04.217674 (+ 3593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.217684 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.217704 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.218255 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.218747 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.218751 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.218754 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.218965 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.219595 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:04.219603 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:04.219991 (+ 388us) client_negotiation.cc:769] Sending connection context
0805 22:57:04.220356 (+ 365us) client_negotiation.cc:240] Negotiation successful
0805 22:57:04.220901 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":400,"threads_started":1}
I20260805 22:57:04.224293 8335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:57:04.243726 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.225446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35458 (local address 127.20.34.125:42725)
0805 22:57:04.226287 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.226299 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.226340 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:57:04.226410 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.226422 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.226719 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.226915 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.227642 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.229545 (+ 1903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.230723 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.231737 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.231898 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.235822 (+ 3924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.235841 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.235865 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.235911 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.240269 (+ 4358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.241066 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.241078 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.241084 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.241248 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.241658 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.241665 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.241671 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.242226 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.242500 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.243064 (+ 564us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.243304 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":605,"thread_start_us":435,"threads_started":1}
I20260805 22:57:04.243688 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.225275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35458)
0805 22:57:04.225503 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.225530 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:04.225667 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:04.226908 (+ 1241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:04.226912 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:04.227318 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:04.227467 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.227476 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.229696 (+ 2220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.229700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.230560 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.230572 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.231914 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.231921 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.232220 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.232932 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:04.232961 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:04.235570 (+ 2609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:04.240463 (+ 4893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.240467 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.240470 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.240901 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.241381 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.241384 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.241387 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.241542 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.242416 (+ 874us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:04.242424 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:04.242686 (+ 262us) client_negotiation.cc:769] Sending connection context
0805 22:57:04.242861 (+ 175us) client_negotiation.cc:240] Negotiation successful
0805 22:57:04.243187 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":4}
I20260805 22:57:04.246707 8335 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:57:04.248385 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.247669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60022)
0805 22:57:04.247908 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.248049 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260805 22:57:04.248735 8259 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
I20260805 22:57:04.250527 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.250166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60034)
0805 22:57:04.250332 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.250418 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260805 22:57:04.250800 8335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab.
Entry for principal kudu/127.20.34.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab.
I20260805 22:57:04.261358 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.124:38765
--webserver_interface=127.20.34.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab
--principal=kudu/127.20.34.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:37429,127.20.34.125:42725,127.20.34.124:38765
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:57:04.300240 8335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 1
I20260805 22:57:04.301543 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.301053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60040)
0805 22:57:04.301265 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.301387 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260805 22:57:04.302688 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.302299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60054)
0805 22:57:04.302495 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.302573 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260805 22:57:04.302990 8335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
I20260805 22:57:04.348667 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } attempt: 5
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970623, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:57:04.364005 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.349623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35466)
0805 22:57:04.349897 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.349923 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:04.350090 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:04.350536 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:04.350541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:04.351010 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:04.351211 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.351222 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.352576 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.352590 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.353526 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.353539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.354377 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.354385 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.354594 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.355318 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:04.355351 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:04.357781 (+ 2430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:04.361314 (+ 3533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.361321 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.361326 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.361750 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.362175 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.362180 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.362184 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.362337 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.362933 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:04.362938 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:04.363113 (+ 175us) client_negotiation.cc:769] Sending connection context
0805 22:57:04.363264 (+ 151us) client_negotiation.cc:240] Negotiation successful
0805 22:57:04.363624 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260805 22:57:04.363986 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.349735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35466 (local address 127.20.34.125:42725)
0805 22:57:04.349934 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.349942 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.349991 (+ 49us) server_negotiation.cc:407] Connection header received
0805 22:57:04.350268 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.350274 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.350366 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.350493 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.351409 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.352410 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.353695 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.354182 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.354343 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.358022 (+ 3679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.358028 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.358031 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.358068 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.361129 (+ 3061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.361899 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.361906 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.361916 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.362047 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.362464 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.362469 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.362473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.362790 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.362974 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.363390 (+ 416us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.363631 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 22:57:04.365212 8223 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:57:04.366501 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.366059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60066)
0805 22:57:04.366250 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.366350 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260805 22:57:04.367569 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.367218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60080)
0805 22:57:04.367375 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.367467 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260805 22:57:04.367774 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
I20260805 22:57:04.371244 8335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 2
I20260805 22:57:04.372431 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.371943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60086)
0805 22:57:04.372147 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.372270 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260805 22:57:04.373474 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.373111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60088)
0805 22:57:04.373267 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.373359 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260805 22:57:04.373754 8335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
I20260805 22:57:04.419052 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 1
I20260805 22:57:04.420403 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.419815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60098)
0805 22:57:04.420042 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.420214 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260805 22:57:04.421404 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.421075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60100)
0805 22:57:04.421227 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.421300 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260805 22:57:04.421614 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
I20260805 22:57:04.465128 8335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 3
I20260805 22:57:04.466487 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.465963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60102)
0805 22:57:04.466179 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.466318 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260805 22:57:04.467633 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.467169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60106)
0805 22:57:04.467417 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.467504 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260805 22:57:04.467875 8335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
I20260805 22:57:04.489832 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 2
I20260805 22:57:04.491072 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.490532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60122)
0805 22:57:04.490798 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.490896 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260805 22:57:04.492071 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.491729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60134)
0805 22:57:04.491888 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.491962 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260805 22:57:04.492291 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
I20260805 22:57:04.598506 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 3
I20260805 22:57:04.599802 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.599194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60148)
0805 22:57:04.599455 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.599573 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260805 22:57:04.601132 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.600609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60150)
0805 22:57:04.600853 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.600967 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260805 22:57:04.601397 8223 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
I20260805 22:57:04.611119 8335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 4
I20260805 22:57:04.612437 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.611854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60152)
0805 22:57:04.612115 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.612267 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260805 22:57:04.613461 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.613139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60162)
0805 22:57:04.613287 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.613366 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260805 22:57:04.613715 8335 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:38765: Network error: Client connection negotiation failed: client connection to 127.20.34.124:38765: connect: Connection refused (error 111)
W20260805 22:57:04.627240 8344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:04.627589 8344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:04.627779 8344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:04.636359 8344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:04.636512 8344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:04.636577 8344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:04.636652 8344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:04.636708 8344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:04.650797 8344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:37429,127.20.34.125:42725,127.20.34.124:38765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab
--principal=kudu/127.20.34.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.124:38765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.34.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:04.652237 8344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:04.653564 8344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:04.666114 8351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:04.666481 8350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:04.666442 8354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:04.667410 8344 server_base.cc:1034] running on GCE node
I20260805 22:57:04.668339 8344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:04.669857 8344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:04.671100 8344 hybrid_clock.cc:648] HybridClock initialized: now 1785970624671059 us; error 48 us; skew 500 ppm
I20260805 22:57:04.671473 8344 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:04.674808 8344 init.cc:377] Logged in from keytab as kudu/127.20.34.124@KRBTEST.COM (short username kudu)
I20260805 22:57:04.676441 8344 webserver.cc:460] Webserver started at http://127.20.34.124:46323/ using document root <none> and password file <none>
I20260805 22:57:04.677201 8344 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:04.677354 8344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:04.677693 8344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:04.681023 8344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/data/instance:
uuid: "e19c8e74ebda415685010b6fca43b09f"
format_stamp: "Formatted at 2026-08-05 22:57:04 on dist-test-slave-gmjp"
server_key: "08c8f489cbd514c18ec378909fc0a77a"
server_key_iv: "2ca7c0db1f0071cbaebd7d34fcb40fd0"
server_key_version: "encryptionkey@0"
I20260805 22:57:04.681886 8344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/wal/instance:
uuid: "e19c8e74ebda415685010b6fca43b09f"
format_stamp: "Formatted at 2026-08-05 22:57:04 on dist-test-slave-gmjp"
server_key: "08c8f489cbd514c18ec378909fc0a77a"
server_key_iv: "2ca7c0db1f0071cbaebd7d34fcb40fd0"
server_key_version: "encryptionkey@0"
I20260805 22:57:04.687415 8344 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:57:04.691046 8368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:04.692591 8344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 22:57:04.692816 8344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/wal
uuid: "e19c8e74ebda415685010b6fca43b09f"
format_stamp: "Formatted at 2026-08-05 22:57:04 on dist-test-slave-gmjp"
server_key: "08c8f489cbd514c18ec378909fc0a77a"
server_key_iv: "2ca7c0db1f0071cbaebd7d34fcb40fd0"
server_key_version: "encryptionkey@0"
I20260805 22:57:04.693009 8344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:04.704893 8344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:04.709350 8344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:04.709638 8344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:04.729803 8344 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.124:38765
I20260805 22:57:04.729826 8439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.124:38765 every 8 connection(s)
I20260805 22:57:04.731405 8344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
I20260805 22:57:04.733911 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 8344
I20260805 22:57:04.734148 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970399628623-20617-0/minicluster-data/master-2/wal/instance
I20260805 22:57:04.734826 20617 external_mini_cluster.cc:1428] Setting key 22e2dea3e1ff3eeba4e952bab5ea8d50
I20260805 22:57:04.736021 8440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:04.744710 8440 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:04.758841 8445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.736971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60174 (local address 127.20.34.124:38765)
0805 22:57:04.737805 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.737818 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.737861 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:57:04.739446 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.739468 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.739886 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.740310 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.741992 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.743450 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.744956 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.745749 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.745968 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.751058 (+ 5090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.751067 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.751077 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.751114 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.754430 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.755165 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.755172 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.755179 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.755381 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.755820 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.755826 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.755829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.756576 (+ 747us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.756913 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.757357 (+ 444us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.757792 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":368,"threads_started":1}
I20260805 22:57:04.762914 8447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.747487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:37429 (local address 127.0.0.1:60340)
0805 22:57:04.748475 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.748518 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:04.748676 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:04.749112 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:04.749117 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:04.749975 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:04.750271 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.750280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.751304 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.751308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.752704 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.752722 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.753566 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.753574 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.753758 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.754384 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:04.754401 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:04.756653 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:04.760028 (+ 3375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.760041 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.760048 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.760615 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.761032 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.761037 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.761041 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.761252 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.761823 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:04.761831 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:04.762049 (+ 218us) client_negotiation.cc:769] Sending connection context
0805 22:57:04.762253 (+ 204us) client_negotiation.cc:240] Negotiation successful
0805 22:57:04.762605 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":578,"threads_started":1}
I20260805 22:57:04.763736 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.747475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60340 (local address 127.20.34.126:37429)
0805 22:57:04.748093 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.748102 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.748621 (+ 519us) server_negotiation.cc:407] Connection header received
0805 22:57:04.748817 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.748824 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.748923 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.749057 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.750442 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.751126 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.752909 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.753363 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.753527 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.756859 (+ 3332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.756864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.756867 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.756902 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.759890 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.760756 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.760764 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.760772 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.760909 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.761375 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.761379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.761381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.761665 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.761830 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.763278 (+ 1448us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.763464 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":276,"threads_started":1}
I20260805 22:57:04.765271 8440 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:57:04.778641 8223 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 4
I20260805 22:57:04.779271 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.761999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60346 (local address 127.20.34.126:37429)
0805 22:57:04.762655 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.762659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.762677 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:57:04.762716 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.762719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.762772 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.762889 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.764722 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.765672 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.767333 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.767758 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.767853 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.773463 (+ 5610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.773469 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.773472 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.773509 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.776238 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.776999 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.777006 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.777010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.777162 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.777581 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.777586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.777590 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.777882 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.778181 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.778509 (+ 328us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.778797 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":301,"threads_started":1}
I20260805 22:57:04.779315 8447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.765976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:42725 (local address 127.0.0.1:35472)
0805 22:57:04.766137 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.766156 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:04.766258 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:04.766596 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:04.766600 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:04.766949 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:04.767094 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.767102 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.768250 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.768259 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.769131 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.769142 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.770172 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.770176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.770341 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.770930 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:04.770947 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:04.773470 (+ 2523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:04.776751 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.776757 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.776761 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.777173 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.777592 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.777597 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.777601 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.777759 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.778285 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:04.778289 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:04.778475 (+ 186us) client_negotiation.cc:769] Sending connection context
0805 22:57:04.778638 (+ 163us) client_negotiation.cc:240] Negotiation successful
0805 22:57:04.778943 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260805 22:57:04.779805 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.766087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35472 (local address 127.20.34.125:42725)
0805 22:57:04.766280 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.766285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.766307 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:57:04.766372 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.766377 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.766454 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.766569 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.767253 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.768078 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.769284 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.770008 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.770155 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.773682 (+ 3527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.773687 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.773690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.773725 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.776606 (+ 2881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.777311 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.777321 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.777323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.777472 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.777882 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.777889 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.777892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.778162 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.778316 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.779313 (+ 997us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.779550 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 22:57:04.780867 8440 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970623, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:57:04.796705 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.779259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60188)
0805 22:57:04.780013 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.780032 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:04.780143 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:04.780742 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:04.780746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:04.781226 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:04.781472 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.781487 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.782791 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.782797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.784073 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.784090 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.785179 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.785186 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.785414 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.786160 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:04.786188 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:04.789033 (+ 2845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:04.793657 (+ 4624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.793662 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.793665 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.794073 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.794555 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.794561 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.794566 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.794751 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.795545 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:04.795549 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:04.795702 (+ 153us) client_negotiation.cc:769] Sending connection context
0805 22:57:04.795848 (+ 146us) client_negotiation.cc:240] Negotiation successful
0805 22:57:04.796210 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616}
I20260805 22:57:04.796691 8445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.780088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60188 (local address 127.20.34.124:38765)
0805 22:57:04.780278 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.780285 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.780304 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:57:04.780356 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.780360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.780441 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.780544 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.781655 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.782656 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.784271 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.784997 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.785138 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.789217 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.789223 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.789228 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.789294 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.793472 (+ 4178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.794220 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.794228 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.794233 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.794430 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.794885 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.794889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.794892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.795207 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.795375 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.795960 (+ 585us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.796306 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260805 22:57:04.799569 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.782902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60196 (local address 127.20.34.124:38765)
0805 22:57:04.783611 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.783618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.783640 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:57:04.783687 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.783692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.783759 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.783876 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.784839 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.786078 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.787336 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.787958 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.788085 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.792376 (+ 4291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.792385 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.792390 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.792443 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.796538 (+ 4095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.797364 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.797368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.797371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.797534 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.797910 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.797914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.797918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.798361 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.798544 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.798891 (+ 347us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.799121 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":325,"threads_started":1}
I20260805 22:57:04.799618 8447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.781578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60196)
0805 22:57:04.781951 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.781967 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:04.782051 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:04.783932 (+ 1881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:04.783937 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:04.784486 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:04.784678 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.784686 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.786229 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.786234 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.787179 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.787194 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.788103 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.788109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.788377 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.788993 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:04.789019 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:04.791998 (+ 2979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:04.796681 (+ 4683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.796687 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.796691 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.797203 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.797652 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.797655 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.797658 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.797792 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.798507 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:04.798512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:04.798651 (+ 139us) client_negotiation.cc:769] Sending connection context
0805 22:57:04.798798 (+ 147us) client_negotiation.cc:240] Negotiation successful
0805 22:57:04.799271 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":147}
I20260805 22:57:04.801707 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.781460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35484 (local address 127.20.34.125:42725)
0805 22:57:04.781631 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.781636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.781792 (+ 156us) server_negotiation.cc:407] Connection header received
0805 22:57:04.781959 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.781964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.782044 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.782151 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.783525 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.784696 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.786420 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.787069 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.787197 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.793529 (+ 6332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.793541 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.793544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.793613 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.798328 (+ 4715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.799363 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.799369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.799372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.799552 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.800434 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.800438 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.800440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.800709 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.800923 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.801263 (+ 340us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.801458 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260805 22:57:04.803797 8223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f: Bootstrap starting.
I20260805 22:57:04.806771 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:57:04.807736 8223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:04.809324 8223 log.cc:824] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:04.816006 8440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: Bootstrap starting.
I20260805 22:57:04.819088 8223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f: No bootstrap required, opened a new log
I20260805 22:57:04.820562 8440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:04.822012 8440 log.cc:824] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:04.831914 8440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: No bootstrap required, opened a new log
I20260805 22:57:04.842247 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.819474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60210 (local address 127.20.34.124:38765)
0805 22:57:04.819918 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.819925 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.819947 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:57:04.820012 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.820018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.820132 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.820275 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.822782 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.824342 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.827335 (+ 2993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.828346 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.828481 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.832901 (+ 4420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.832909 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.832913 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.832955 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.837001 (+ 4046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.838132 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.838144 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.838148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.838317 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.838889 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.839003 (+ 114us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.839011 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.839564 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.839840 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.841490 (+ 1650us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.841770 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297}
I20260805 22:57:04.845458 8440 raft_consensus.cc:348] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:04.845486 8223 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:04.846005 8440 raft_consensus.cc:374] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:04.846161 8440 raft_consensus.cc:729] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19c8e74ebda415685010b6fca43b09f, State: Initialized, Role: FOLLOWER
I20260805 22:57:04.846343 8223 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:04.846540 8223 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed93ed915b43898a35b872c605f01f, State: Initialized, Role: FOLLOWER
I20260805 22:57:04.847129 8440 consensus_queue.cc:260] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:04.847306 8223 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:04.861411 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.818824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60352 (local address 127.20.34.126:37429)
0805 22:57:04.819049 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.819055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.829118 (+ 10063us) server_negotiation.cc:407] Connection header received
0805 22:57:04.829747 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.829757 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.829883 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.829976 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.840322 (+ 10346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.841798 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.844958 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.845697 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.845839 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.850274 (+ 4435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.850284 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.850292 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.850366 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.855167 (+ 4801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.856500 (+ 1333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.856509 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.856515 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.856734 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.857378 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.857386 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.857392 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.857868 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.858201 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.859151 (+ 950us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.860832 (+ 1681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:57:04.865439 8466 sys_catalog.cc:455] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:04.866047 8466 sys_catalog.cc:458] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:57:04.866781 8470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:04.867267 8470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:57:04.867405 8440 sys_catalog.cc:564] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:57:04.868041 8223 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:57:04.868477 8152 tablet.cc:2369] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:57:04.870272 8341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.824691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35486 (local address 127.20.34.125:42725)
0805 22:57:04.824924 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.824934 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.844600 (+ 19666us) server_negotiation.cc:407] Connection header received
0805 22:57:04.844935 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.844942 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.845045 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.845178 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.848622 (+ 3444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.850320 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.853356 (+ 3036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.854387 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.854531 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.859620 (+ 5089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.859633 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.859641 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.859705 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.865352 (+ 5647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.866720 (+ 1368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.866727 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.866731 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.866922 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.867686 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.867691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.867694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.868164 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.868502 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.869288 (+ 786us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.869669 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260805 22:57:04.882304 8487 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:57:04.882493 8487 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260805 22:57:04.890407 8498 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:57:04.890607 8498 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:57:04.879020 8122 master_runner.cc:186] Error getting master registration for 127.20.34.125:42725: OK, instance_id { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" instance_seqno: 1785970624174566 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:57:04.899163 8122 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:57:04.891148 8344 master_runner.cc:186] Error getting master registration for 127.20.34.125:42725: OK, instance_id { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" instance_seqno: 1785970624174566 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:57:04.908231 8344 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:57:04.912972 8335 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } attempt: 5
Aug 05 22:57:04 dist-test-slave-gmjp krb5kdc[8098](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970624, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
I20260805 22:57:04.931540 8339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.913761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:38765 (local address 127.0.0.1:60214)
0805 22:57:04.914000 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:04.914026 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:04.914172 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:04.914845 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:04.914850 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:04.915488 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:04.915727 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.915741 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.917761 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.917768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.918704 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:04.918715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.919517 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.919523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:04.919774 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.920504 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:04.920524 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:04.922681 (+ 2157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:04.926250 (+ 3569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.926255 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.926259 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.926723 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.927279 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:04.927284 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:04.929349 (+ 2065us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:04.929575 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:04.930434 (+ 859us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:04.930438 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:04.930584 (+ 146us) client_negotiation.cc:769] Sending connection context
0805 22:57:04.930744 (+ 160us) client_negotiation.cc:240] Negotiation successful
0805 22:57:04.931112 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260805 22:57:04.931548 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:04.913884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60214 (local address 127.20.34.124:38765)
0805 22:57:04.914064 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:04.914068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:04.914090 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:57:04.914393 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:04.914400 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:04.914485 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:04.914608 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:04.916614 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.917609 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.918867 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:04.919331 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:04.919500 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:04.922933 (+ 3433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:04.922938 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:04.922941 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:04.922979 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:04.926051 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.926860 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.926867 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.926871 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.927116 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:04.929731 (+ 2615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:04.929736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:04.929739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:04.930157 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:04.930350 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:04.930872 (+ 522us) server_negotiation.cc:299] Negotiation successful
0805 22:57:04.931129 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 22:57:04.936681 8335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: Bootstrap starting.
I20260805 22:57:04.941147 8335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:04.942535 8335 log.cc:824] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:04.945796 8335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: No bootstrap required, opened a new log
I20260805 22:57:04.953661 8335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:04.954144 8335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:04.954279 8335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c2502b42dd94493abf279daa49d002a, State: Initialized, Role: FOLLOWER
I20260805 22:57:04.955114 8335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:04.959730 8501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:04.960319 8501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:57:04.961210 8335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:57:04.961836 8380 tablet.cc:2369] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:57:04.979950 8232 master_runner.cc:263] No leader master found from master 9c2502b42dd94493abf279daa49d002a
I20260805 22:57:04.980130 8232 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260805 22:57:04.987036 8530 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:57:04.987329 8530 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:57:05.146209 8470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:57:05.146607 8470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:05.148504 8470 leader_election.cc:288] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c2502b42dd94493abf279daa49d002a (127.20.34.125:42725), e19c8e74ebda415685010b6fca43b09f (127.20.34.124:38765)
I20260805 22:57:05.149518 8406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ed93ed915b43898a35b872c605f01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c8e74ebda415685010b6fca43b09f" is_pre_election: true
I20260805 22:57:05.149609 8293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ed93ed915b43898a35b872c605f01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c2502b42dd94493abf279daa49d002a" is_pre_election: true
I20260805 22:57:05.150247 8406 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed93ed915b43898a35b872c605f01f in term 0.
I20260805 22:57:05.150426 8293 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed93ed915b43898a35b872c605f01f in term 0.
I20260805 22:57:05.151012 8149 leader_election.cc:302] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed93ed915b43898a35b872c605f01f, e19c8e74ebda415685010b6fca43b09f; no voters:
I20260805 22:57:05.151824 8470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:57:05.152012 8470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:57:05.152123 8470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:05.156294 8470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:05.157732 8293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ed93ed915b43898a35b872c605f01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c2502b42dd94493abf279daa49d002a"
I20260805 22:57:05.158015 8293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:05.161799 8293 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed93ed915b43898a35b872c605f01f in term 1.
W20260805 22:57:05.163192 8264 tablet.cc:2369] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:57:05.164391 8148 leader_election.cc:302] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed93ed915b43898a35b872c605f01f, 9c2502b42dd94493abf279daa49d002a; no voters:
I20260805 22:57:05.169628 8533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:57:05.169761 8406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ed93ed915b43898a35b872c605f01f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19c8e74ebda415685010b6fca43b09f"
I20260805 22:57:05.170050 8406 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:05.173944 8406 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed93ed915b43898a35b872c605f01f in term 1.
I20260805 22:57:05.174768 8470 leader_election.cc:288] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [CANDIDATE]: Term 1 election: Requested vote from peers 9c2502b42dd94493abf279daa49d002a (127.20.34.125:42725), e19c8e74ebda415685010b6fca43b09f (127.20.34.124:38765)
I20260805 22:57:05.184700 8533 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [term 1 LEADER]: Becoming Leader. State: Replica: 65ed93ed915b43898a35b872c605f01f, State: Running, Role: LEADER
I20260805 22:57:05.185510 8533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } }
I20260805 22:57:05.201474 8470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ed93ed915b43898a35b872c605f01f. Latest consensus state: current_term: 1 leader_uuid: "65ed93ed915b43898a35b872c605f01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:05.201849 8470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:05.208845 8537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:57:05.211766 8537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:57:05.239857 8406 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [term 1 FOLLOWER]: Refusing update from remote peer 65ed93ed915b43898a35b872c605f01f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:57:05.241180 8293 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [term 1 FOLLOWER]: Refusing update from remote peer 65ed93ed915b43898a35b872c605f01f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:57:05.242336 8533 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:57:05.242756 8470 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:57:05.267453 8501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ed93ed915b43898a35b872c605f01f. Latest consensus state: current_term: 1 leader_uuid: "65ed93ed915b43898a35b872c605f01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:05.267817 8501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:57:05.273763 8466 sys_catalog.cc:455] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ed93ed915b43898a35b872c605f01f. Latest consensus state: current_term: 1 leader_uuid: "65ed93ed915b43898a35b872c605f01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:05.274137 8466 sys_catalog.cc:458] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:57:05.286697 8541 mvcc.cc:205] Tried to move back new op lower bound from 7315335680969707520 to 7315335680765566976. Current Snapshot: MvccSnapshot[applied={T|T < 7315335680969707520}]
I20260805 22:57:05.296538 8466 sys_catalog.cc:455] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65ed93ed915b43898a35b872c605f01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:05.296521 8534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65ed93ed915b43898a35b872c605f01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:05.296867 8466 sys_catalog.cc:458] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:57:05.296921 8534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:05.296744 8501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "65ed93ed915b43898a35b872c605f01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:05.297046 8501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:57:05.297194 8533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "65ed93ed915b43898a35b872c605f01f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed93ed915b43898a35b872c605f01f" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37429 } } peers { permanent_uuid: "9c2502b42dd94493abf279daa49d002a" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 42725 } } peers { permanent_uuid: "e19c8e74ebda415685010b6fca43b09f" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 38765 } } }
I20260805 22:57:05.297479 8533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:05.304915 8537 catalog_manager.cc:1347] Generated new cluster ID: 9c3efed78efd4466b2a8e8bb030f44f9
I20260805 22:57:05.305052 8537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:57:05.344991 8537 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:57:05.346913 8537 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:57:05.395323 8537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65ed93ed915b43898a35b872c605f01f: Generated new TSK 0
I20260805 22:57:05.396633 8537 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:57:05.892864 8498 catalog_manager.cc:1259] Loaded cluster ID: 9c3efed78efd4466b2a8e8bb030f44f9
I20260805 22:57:05.893018 8498 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: loading cluster ID for follower catalog manager: success
I20260805 22:57:05.895612 8498 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: acquiring CA information for follower catalog manager: success
I20260805 22:57:05.897670 8498 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e19c8e74ebda415685010b6fca43b09f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:57:05.989645 8530 catalog_manager.cc:1259] Loaded cluster ID: 9c3efed78efd4466b2a8e8bb030f44f9
I20260805 22:57:05.989797 8530 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: loading cluster ID for follower catalog manager: success
I20260805 22:57:05.992419 8530 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: acquiring CA information for follower catalog manager: success
I20260805 22:57:05.994382 8530 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c2502b42dd94493abf279daa49d002a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:57:06.071074 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 8122
I20260805 22:57:06.072530 8218 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:06.191228 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 8122
I20260805 22:57:06.225695 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 8232
I20260805 22:57:06.226858 8327 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:06.339071 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 8232
I20260805 22:57:06.369736 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 8344
I20260805 22:57:06.371027 8432 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:06.484383 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 8344
2026-08-05T22:57:06Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5000 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:57:06 dist-test-slave-gmjp krb5kdc[8559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:57:06 dist-test-slave-gmjp krb5kdc[8559](info): set up 2 sockets
Aug 05 22:57:06 dist-test-slave-gmjp krb5kdc[8559](info): commencing operation
krb5kdc: starting...
W20260805 22:57:07.821841 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:57:08 dist-test-slave-gmjp krb5kdc[8559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:57:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:57:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:57:08.166165 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:36275
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:42491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:36275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:08.529506 8582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:08.529858 8582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:08.530043 8582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:08.537667 8582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:08.537796 8582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:08.537892 8582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:08.538013 8582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:08.538076 8582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:08.548969 8582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:36275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:36275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:08.550446 8582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:08.551856 8582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:08.564710 8592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:08.564666 8593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:08.564684 8597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:08.566009 8582 server_base.cc:1034] running on GCE node
I20260805 22:57:08.566874 8582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:08.568608 8582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:08.569859 8582 hybrid_clock.cc:648] HybridClock initialized: now 1785970628569813 us; error 68 us; skew 500 ppm
I20260805 22:57:08.570245 8582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:08 dist-test-slave-gmjp krb5kdc[8559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970628, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:08.578078 8582 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:57:08.579990 8582 webserver.cc:460] Webserver started at http://127.20.34.126:38599/ using document root <none> and password file <none>
I20260805 22:57:08.580829 8582 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:08.580994 8582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:08.581337 8582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:08.584699 8582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "cb1cfccad96a4ab3b5bd27faf712e23b"
format_stamp: "Formatted at 2026-08-05 22:57:08 on dist-test-slave-gmjp"
server_key: "d058a72a4ae22d4a79775b30a4ac6147"
server_key_iv: "4669b91640bc7dc8100b26e6b509f378"
server_key_version: "encryptionkey@0"
I20260805 22:57:08.585532 8582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "cb1cfccad96a4ab3b5bd27faf712e23b"
format_stamp: "Formatted at 2026-08-05 22:57:08 on dist-test-slave-gmjp"
server_key: "d058a72a4ae22d4a79775b30a4ac6147"
server_key_iv: "4669b91640bc7dc8100b26e6b509f378"
server_key_version: "encryptionkey@0"
I20260805 22:57:08.591318 8582 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:57:08.595459 8609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:08.597051 8582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 22:57:08.597272 8582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "cb1cfccad96a4ab3b5bd27faf712e23b"
format_stamp: "Formatted at 2026-08-05 22:57:08 on dist-test-slave-gmjp"
server_key: "d058a72a4ae22d4a79775b30a4ac6147"
server_key_iv: "4669b91640bc7dc8100b26e6b509f378"
server_key_version: "encryptionkey@0"
I20260805 22:57:08.597509 8582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:08.624078 8582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:08.629143 8582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:08.629487 8582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:08.649914 8582 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:36275
I20260805 22:57:08.649969 8682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:36275 every 8 connection(s)
I20260805 22:57:08.651386 8582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:57:08.655378 8683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:08.660369 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 8582
I20260805 22:57:08.660622 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:57:08.661324 20617 external_mini_cluster.cc:1428] Setting key fa728d0060c80760535d711a8e864b6d
I20260805 22:57:08.666893 8683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b: Bootstrap starting.
I20260805 22:57:08.670768 8683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:08.672094 8683 log.cc:824] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:08.675957 8683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b: No bootstrap required, opened a new log
Aug 05 22:57:08 dist-test-slave-gmjp krb5kdc[8559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:08.684834 8683 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb1cfccad96a4ab3b5bd27faf712e23b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36275 } }
I20260805 22:57:08.685289 8683 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:08.685423 8683 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb1cfccad96a4ab3b5bd27faf712e23b, State: Initialized, Role: FOLLOWER
I20260805 22:57:08.686192 8683 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb1cfccad96a4ab3b5bd27faf712e23b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36275 } }
I20260805 22:57:08.686478 8683 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:57:08.686646 8683 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:57:08.686880 8683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:08.687573 8689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:08.663365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39672 (local address 127.20.34.126:36275)
0805 22:57:08.664331 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:08.664343 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:08.664395 (+ 52us) server_negotiation.cc:407] Connection header received
0805 22:57:08.666153 (+ 1758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:08.666179 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:08.666591 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:08.666917 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:08.668908 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:08.670230 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:08.672392 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:08.673524 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:08.673701 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:08.679068 (+ 5367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:08.679077 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:08.679094 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:08.679138 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:08.682666 (+ 3528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:08.683569 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:08.683576 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:08.683584 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:08.683783 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:08.684296 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:08.684305 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:08.684307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:08.684907 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:08.685239 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:08.685754 (+ 515us) server_negotiation.cc:299] Negotiation successful
0805 22:57:08.686221 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":428,"threads_started":1}
I20260805 22:57:08.689468 8683 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb1cfccad96a4ab3b5bd27faf712e23b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36275 } }
I20260805 22:57:08.690002 8683 leader_election.cc:302] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb1cfccad96a4ab3b5bd27faf712e23b; no voters:
I20260805 22:57:08.690701 8683 leader_election.cc:288] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:57:08.690843 8693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:57:08.692126 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:57:08.692252 8693 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [term 1 LEADER]: Becoming Leader. State: Replica: cb1cfccad96a4ab3b5bd27faf712e23b, State: Running, Role: LEADER
I20260805 22:57:08.692864 8693 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb1cfccad96a4ab3b5bd27faf712e23b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36275 } }
I20260805 22:57:08.693259 8683 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:57:08.701316 8694 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb1cfccad96a4ab3b5bd27faf712e23b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb1cfccad96a4ab3b5bd27faf712e23b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36275 } } }
I20260805 22:57:08.701776 8694 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:08.702080 8695 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb1cfccad96a4ab3b5bd27faf712e23b. Latest consensus state: current_term: 1 leader_uuid: "cb1cfccad96a4ab3b5bd27faf712e23b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb1cfccad96a4ab3b5bd27faf712e23b" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 36275 } } }
I20260805 22:57:08.702381 8695 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b [sys.catalog]: This master's current role is: LEADER
W20260805 22:57:08.711256 8710 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:57:08.711438 8710 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:57:08.712754 8711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:57:08.714596 8711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:57:08.722955 8711 catalog_manager.cc:1347] Generated new cluster ID: d1ad70a6dede426e90288cf2ebe93afb
I20260805 22:57:08.723094 8711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:57:08.737380 8711 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:57:08.739357 8711 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:57:08.751063 8711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb1cfccad96a4ab3b5bd27faf712e23b: Generated new TSK 0
I20260805 22:57:08.752403 8711 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:57:08.807773 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 8582
I20260805 22:57:08.809275 8676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:08.909806 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 8582
2026-08-05T22:57:08Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2424 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:57:09 dist-test-slave-gmjp krb5kdc[8725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:57:09 dist-test-slave-gmjp krb5kdc[8725](info): set up 2 sockets
Aug 05 22:57:09 dist-test-slave-gmjp krb5kdc[8725](info): commencing operation
krb5kdc: starting...
W20260805 22:57:10.242360 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.285s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:57:10 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:57:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:57:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:57:10.584096 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34873
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:34873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:10.953032 8741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:10.953354 8741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:10.953516 8741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:10.961321 8741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:10.961453 8741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:10.961566 8741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:10.961688 8741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:10.961772 8741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:10.972505 8741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:34873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:10.974004 8741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:10.975414 8741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:10.988189 8748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:10.988407 8749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:10.988544 8751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:10.989604 8741 server_base.cc:1034] running on GCE node
I20260805 22:57:10.990406 8741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:10.991968 8741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:10.993214 8741 hybrid_clock.cc:648] HybridClock initialized: now 1785970630993149 us; error 57 us; skew 500 ppm
I20260805 22:57:10.993610 8741 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:10 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970630, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:10.997166 8741 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:57:10.998858 8741 webserver.cc:460] Webserver started at http://127.20.34.126:40763/ using document root <none> and password file <none>
I20260805 22:57:10.999580 8741 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:10.999686 8741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:10.999955 8741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:11.003213 8741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "b8a26049955642a2bf9af7ab034c06a9"
format_stamp: "Formatted at 2026-08-05 22:57:10 on dist-test-slave-gmjp"
server_key: "1cff11c5d13acc245e41dbb83057fff0"
server_key_iv: "4ede06ca4b566698cb5b3996e8ab454e"
server_key_version: "encryptionkey@0"
I20260805 22:57:11.004022 8741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "b8a26049955642a2bf9af7ab034c06a9"
format_stamp: "Formatted at 2026-08-05 22:57:10 on dist-test-slave-gmjp"
server_key: "1cff11c5d13acc245e41dbb83057fff0"
server_key_iv: "4ede06ca4b566698cb5b3996e8ab454e"
server_key_version: "encryptionkey@0"
I20260805 22:57:11.009796 8741 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260805 22:57:11.013835 8758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:11.015436 8741 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:57:11.015602 8741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "b8a26049955642a2bf9af7ab034c06a9"
format_stamp: "Formatted at 2026-08-05 22:57:10 on dist-test-slave-gmjp"
server_key: "1cff11c5d13acc245e41dbb83057fff0"
server_key_iv: "4ede06ca4b566698cb5b3996e8ab454e"
server_key_version: "encryptionkey@0"
I20260805 22:57:11.015823 8741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:11.033265 8741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:11.038158 8741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:11.038430 8741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:11.059352 8741 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:34873
I20260805 22:57:11.059383 8834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:34873 every 8 connection(s)
I20260805 22:57:11.060967 8741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:57:11.065114 8835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:11.068789 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 8741
I20260805 22:57:11.069067 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:57:11.069975 20617 external_mini_cluster.cc:1428] Setting key 36d53beffb10e60e746bf1921a7dd5da
I20260805 22:57:11.080096 8835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Bootstrap starting.
I20260805 22:57:11.084815 8835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:11.086364 8835 log.cc:824] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Log is configured to *not* fsync() on all Append() calls
Aug 05 22:57:11 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:11.090076 8835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: No bootstrap required, opened a new log
I20260805 22:57:11.097517 8838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:11.072518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41358 (local address 127.20.34.126:34873)
0805 22:57:11.073404 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:11.073417 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:11.073469 (+ 52us) server_negotiation.cc:407] Connection header received
0805 22:57:11.075257 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:11.075286 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:11.075763 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:11.076241 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:11.078284 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:11.079710 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:11.082076 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:11.082858 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:11.083023 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:11.088929 (+ 5906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:11.088958 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:11.088976 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:11.089017 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:11.092522 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:11.093622 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:11.093631 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:11.093643 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:11.093853 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:11.094327 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:11.094331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:11.094333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:11.094964 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:11.095267 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:11.095786 (+ 519us) server_negotiation.cc:299] Negotiation successful
0805 22:57:11.096311 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":414,"threads_started":1}
I20260805 22:57:11.100240 8835 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:11.100701 8835 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:11.100857 8835 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8a26049955642a2bf9af7ab034c06a9, State: Initialized, Role: FOLLOWER
I20260805 22:57:11.101507 8835 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:11.101730 8835 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:57:11.101842 8835 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:57:11.101966 8835 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:11.104388 8835 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:11.105041 8835 leader_election.cc:302] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8a26049955642a2bf9af7ab034c06a9; no voters:
I20260805 22:57:11.105623 8835 leader_election.cc:288] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:57:11.105784 8842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:57:11.106580 8842 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 1 LEADER]: Becoming Leader. State: Replica: b8a26049955642a2bf9af7ab034c06a9, State: Running, Role: LEADER
I20260805 22:57:11.107151 8842 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:11.107987 8835 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:57:11.110426 8845 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8a26049955642a2bf9af7ab034c06a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } } }
I20260805 22:57:11.110692 8846 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a26049955642a2bf9af7ab034c06a9. Latest consensus state: current_term: 1 leader_uuid: "b8a26049955642a2bf9af7ab034c06a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } } }
I20260805 22:57:11.110952 8845 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:11.111035 8846 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:11.117115 8850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:57:11.122469 8850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:57:11.132071 8850 catalog_manager.cc:1347] Generated new cluster ID: 690b2fad85254217b670410c67c00a9c
I20260805 22:57:11.132292 8850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:57:11.149883 8850 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:57:11.151295 8850 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:57:11.164505 8850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Generated new TSK 0
I20260805 22:57:11.165704 8850 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:57:11.263374 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34873
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:11.654433 8871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:11.654747 8871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:11.654942 8871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:11.662746 8871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:11.662882 8871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:11.663064 8871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:57:11.673702 8871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:11.675139 8871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:11.676677 8871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:11.690251 8882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:11.690250 8880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:11.690339 8878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:11.693599 8871 server_base.cc:1034] running on GCE node
I20260805 22:57:11.694271 8871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:11.695374 8871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:11.696611 8871 hybrid_clock.cc:648] HybridClock initialized: now 1785970631696561 us; error 44 us; skew 500 ppm
I20260805 22:57:11.696969 8871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:11 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970631, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:11.700395 8871 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:57:11.702085 8871 webserver.cc:460] Webserver started at http://127.20.34.65:36315/ using document root <none> and password file <none>
I20260805 22:57:11.702795 8871 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:11.702908 8871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:11.703208 8871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:11.706377 8871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "60839f62b23f47ee84c632fda6801603"
format_stamp: "Formatted at 2026-08-05 22:57:11 on dist-test-slave-gmjp"
server_key: "47947ef04bc1f9b87bf6ae2085016849"
server_key_iv: "3d396b5cd7fb848bf4ce177c60d91163"
server_key_version: "encryptionkey@0"
I20260805 22:57:11.707162 8871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "60839f62b23f47ee84c632fda6801603"
format_stamp: "Formatted at 2026-08-05 22:57:11 on dist-test-slave-gmjp"
server_key: "47947ef04bc1f9b87bf6ae2085016849"
server_key_iv: "3d396b5cd7fb848bf4ce177c60d91163"
server_key_version: "encryptionkey@0"
I20260805 22:57:11.713335 8871 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 22:57:11.717485 8891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:11.719098 8871 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:57:11.719302 8871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "60839f62b23f47ee84c632fda6801603"
format_stamp: "Formatted at 2026-08-05 22:57:11 on dist-test-slave-gmjp"
server_key: "47947ef04bc1f9b87bf6ae2085016849"
server_key_iv: "3d396b5cd7fb848bf4ce177c60d91163"
server_key_version: "encryptionkey@0"
I20260805 22:57:11.719532 8871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:11.744490 8871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:11.749519 8871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:11.749886 8871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:11.751014 8871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:11.752503 8871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:11.752581 8871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:11.752739 8871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:11.752810 8871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:11.789754 8871 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34891
I20260805 22:57:11.789809 9053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34891 every 8 connection(s)
I20260805 22:57:11.791118 8871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:57:11.793038 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 8871
I20260805 22:57:11.793268 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:57:11.794052 20617 external_mini_cluster.cc:1428] Setting key 6dbe54da61ebd39251dc840aaf2b4263
Aug 05 22:57:11 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970631, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:11.817289 9056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:11.794125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:38139 (local address 127.20.34.126:34873)
0805 22:57:11.794685 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:11.794692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:11.795737 (+ 1045us) server_negotiation.cc:407] Connection header received
0805 22:57:11.798635 (+ 2898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:11.798640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:11.798718 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:11.798818 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:11.801198 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:11.801949 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:11.804755 (+ 2806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:11.805220 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:11.805348 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:11.810204 (+ 4856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:11.810210 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:11.810214 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:11.810254 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:11.813140 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:11.814208 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:11.814213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:11.814216 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:11.814352 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:11.814966 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:11.814971 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:11.814976 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:11.815342 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:11.815510 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:11.816579 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0805 22:57:11.816920 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":279,"threads_started":1}
I20260805 22:57:11.818328 9057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:11.794771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:38139)
0805 22:57:11.795586 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:11.795625 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:11.798219 (+ 2594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:11.799156 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:11.799172 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:11.800057 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:11.800996 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:11.801026 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:11.802134 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:11.802143 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:11.804549 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:11.804571 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:11.805504 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:11.805514 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:11.805900 (+ 386us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:11.806748 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:11.806797 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:11.809894 (+ 3097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:11.813359 (+ 3465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:11.813370 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:11.813398 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:11.814046 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:11.814481 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:11.814486 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:11.814490 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:11.814813 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:11.815483 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:11.815492 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:11.816001 (+ 509us) client_negotiation.cc:769] Sending connection context
0805 22:57:11.816373 (+ 372us) client_negotiation.cc:240] Negotiation successful
0805 22:57:11.816984 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":326,"threads_started":1}
I20260805 22:57:11.820341 9054 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34873
I20260805 22:57:11.820727 9054 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:11.821564 9054 heartbeater.cc:511] Master 127.20.34.126:34873 requested a full tablet report, sending...
I20260805 22:57:11.824080 8779 ts_manager.cc:194] Registered new tserver with Master: 60839f62b23f47ee84c632fda6801603 (127.20.34.65:34891)
I20260805 22:57:11.825881 8779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:38139
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:57:11.872826 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34873
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:12.242882 9061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:12.243297 9061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:12.243482 9061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:12.251353 9061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:12.251540 9061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:12.251749 9061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:57:12.262280 9061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:12.263767 9061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:12.265363 9061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:12.279312 9067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:12.279364 9072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:12.279381 9069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:12.280702 9061 server_base.cc:1034] running on GCE node
I20260805 22:57:12.281472 9061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:12.282516 9061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:12.283778 9061 hybrid_clock.cc:648] HybridClock initialized: now 1785970632283729 us; error 37 us; skew 500 ppm
I20260805 22:57:12.284144 9061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:12 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970632, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:12.287739 9061 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:57:12.289324 9061 webserver.cc:460] Webserver started at http://127.20.34.66:33235/ using document root <none> and password file <none>
I20260805 22:57:12.290079 9061 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:12.290234 9061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:12.290572 9061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:12.293998 9061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "df090b9997d74b82a1e0b3f8c450b5a7"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "fdc9d3d3e1b42db2121d9739bd0779c0"
server_key_iv: "e239aa1cca70ef44e891da5ba53fbe48"
server_key_version: "encryptionkey@0"
I20260805 22:57:12.294994 9061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "df090b9997d74b82a1e0b3f8c450b5a7"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "fdc9d3d3e1b42db2121d9739bd0779c0"
server_key_iv: "e239aa1cca70ef44e891da5ba53fbe48"
server_key_version: "encryptionkey@0"
I20260805 22:57:12.300758 9061 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260805 22:57:12.304891 9080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:12.306924 9061 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 22:57:12.307122 9061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "df090b9997d74b82a1e0b3f8c450b5a7"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "fdc9d3d3e1b42db2121d9739bd0779c0"
server_key_iv: "e239aa1cca70ef44e891da5ba53fbe48"
server_key_version: "encryptionkey@0"
I20260805 22:57:12.307344 9061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:12.335907 9061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:12.340320 9061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:12.340646 9061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:12.341723 9061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:12.343317 9061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:12.343397 9061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:12.343551 9061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:12.343607 9061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:12.379195 9061 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:45927
I20260805 22:57:12.379240 9250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:45927 every 8 connection(s)
I20260805 22:57:12.380620 9061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:57:12.387303 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 9061
I20260805 22:57:12.387519 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:57:12.388022 20617 external_mini_cluster.cc:1428] Setting key d7e3f9f9cb9e07983837bd13972d53ea
Aug 05 22:57:12 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970632, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:12.403669 9253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:12.383354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:52701 (local address 127.20.34.126:34873)
0805 22:57:12.383884 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:12.383889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:12.384852 (+ 963us) server_negotiation.cc:407] Connection header received
0805 22:57:12.386778 (+ 1926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:12.386784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:12.386908 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:12.387033 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:12.388871 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.389663 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.391422 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.392248 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.392401 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:12.396222 (+ 3821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:12.396231 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:12.396237 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:12.396289 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:12.400062 (+ 3773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:12.400911 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:12.400920 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:12.400926 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:12.401093 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:12.401535 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:12.401542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:12.401547 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:12.401991 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:12.402167 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:12.402909 (+ 742us) server_negotiation.cc:299] Negotiation successful
0805 22:57:12.403187 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":262,"threads_started":1}
I20260805 22:57:12.404510 9255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:12.383804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:52701)
0805 22:57:12.384679 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:12.384728 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:12.386488 (+ 1760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:12.387287 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:12.387295 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:12.387940 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:12.388658 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:12.388688 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.389836 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.389840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:12.391255 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:12.391273 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.392468 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.392473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:12.392670 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:12.393410 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:12.393434 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:12.395925 (+ 2491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:12.400272 (+ 4347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:12.400280 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:12.400296 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:12.400784 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:12.401209 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:12.401212 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:12.401214 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:12.401423 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:12.402122 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:12.402129 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:12.402516 (+ 387us) client_negotiation.cc:769] Sending connection context
0805 22:57:12.402763 (+ 247us) client_negotiation.cc:240] Negotiation successful
0805 22:57:12.403187 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":351,"threads_started":1}
I20260805 22:57:12.406270 9251 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34873
I20260805 22:57:12.406665 9251 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:12.407563 9251 heartbeater.cc:511] Master 127.20.34.126:34873 requested a full tablet report, sending...
I20260805 22:57:12.409600 8779 ts_manager.cc:194] Registered new tserver with Master: df090b9997d74b82a1e0b3f8c450b5a7 (127.20.34.66:45927)
I20260805 22:57:12.410485 8779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:52701
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:57:12.460963 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34873
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:12.823459 9258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:12.823804 9258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:12.823982 9258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260805 22:57:12.829516 9054 heartbeater.cc:503] Master 127.20.34.126:34873 was elected leader, sending a full tablet report...
W20260805 22:57:12.831611 9258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:12.831777 9258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:12.831960 9258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:57:12.842703 9258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:12.844295 9258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:12.845801 9258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:12.859678 9263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:12.859668 9267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:12.859735 9264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:12.861455 9258 server_base.cc:1034] running on GCE node
I20260805 22:57:12.862120 9258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:12.863293 9258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:12.864506 9258 hybrid_clock.cc:648] HybridClock initialized: now 1785970632864461 us; error 33 us; skew 500 ppm
I20260805 22:57:12.864818 9258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:12 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970632, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:12.868314 9258 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:57:12.869864 9258 webserver.cc:460] Webserver started at http://127.20.34.67:34859/ using document root <none> and password file <none>
I20260805 22:57:12.870568 9258 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:12.870674 9258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:12.870945 9258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:12.874202 9258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "5180efcb3f5d4168bb8e6b5e4d827cec"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "c4032e507bb654f3e6ed436a72b7b91c"
server_key_iv: "faa088676f1fb86b1b2d3b4d4286b5a8"
server_key_version: "encryptionkey@0"
I20260805 22:57:12.875052 9258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "5180efcb3f5d4168bb8e6b5e4d827cec"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "c4032e507bb654f3e6ed436a72b7b91c"
server_key_iv: "faa088676f1fb86b1b2d3b4d4286b5a8"
server_key_version: "encryptionkey@0"
I20260805 22:57:12.880542 9258 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:57:12.883977 9278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:12.885437 9258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:57:12.885649 9258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "5180efcb3f5d4168bb8e6b5e4d827cec"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "c4032e507bb654f3e6ed436a72b7b91c"
server_key_iv: "faa088676f1fb86b1b2d3b4d4286b5a8"
server_key_version: "encryptionkey@0"
I20260805 22:57:12.885890 9258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:12.901562 9258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:12.906234 9258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:12.906504 9258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:12.907439 9258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:12.908984 9258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:12.909060 9258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:12.909147 9258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:12.909195 9258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:12.944686 9258 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:35041
I20260805 22:57:12.944736 9453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:35041 every 8 connection(s)
I20260805 22:57:12.946117 9258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:57:12.954891 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 9258
I20260805 22:57:12.955124 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:57:12.955611 20617 external_mini_cluster.cc:1428] Setting key ee29047a519c7ed9ccc76940589d9336
Aug 05 22:57:12 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970632, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:12.967931 9458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:12.948861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:59793 (local address 127.20.34.126:34873)
0805 22:57:12.949407 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:12.949412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:12.950174 (+ 762us) server_negotiation.cc:407] Connection header received
0805 22:57:12.952082 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:12.952088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:12.952255 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:12.952380 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:12.953967 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.954764 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.956950 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.957714 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.957878 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:12.961856 (+ 3978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:12.961862 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:12.961866 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:12.961912 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:12.964913 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:12.965751 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:12.965755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:12.965758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:12.965874 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:12.966292 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:12.966295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:12.966297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:12.966569 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:12.966697 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:12.967468 (+ 771us) server_negotiation.cc:299] Negotiation successful
0805 22:57:12.967639 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":283,"threads_started":1}
I20260805 22:57:12.969067 9459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:12.949267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:59793)
0805 22:57:12.949999 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:12.950046 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:12.951780 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:12.952638 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:12.952647 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:12.953187 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:12.953780 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:12.953798 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.954930 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.954935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:12.956763 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:12.956782 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.957975 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.957981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:12.958286 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:12.959201 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:12.959236 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:12.961601 (+ 2365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:12.965102 (+ 3501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:12.965110 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:12.965126 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:12.965637 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:12.965983 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:12.965986 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:12.965989 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:12.966193 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:12.966727 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:12.966734 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:12.967111 (+ 377us) client_negotiation.cc:769] Sending connection context
0805 22:57:12.967379 (+ 268us) client_negotiation.cc:240] Negotiation successful
0805 22:57:12.967822 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":283,"threads_started":1}
I20260805 22:57:12.970885 9454 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34873
I20260805 22:57:12.971328 9454 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:12.972353 9454 heartbeater.cc:511] Master 127.20.34.126:34873 requested a full tablet report, sending...
I20260805 22:57:12.973806 8779 ts_manager.cc:194] Registered new tserver with Master: 5180efcb3f5d4168bb8e6b5e4d827cec (127.20.34.67:35041)
I20260805 22:57:12.974612 8779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:59793
I20260805 22:57:12.984639 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:57:13.003108 9458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:12.989715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.20.34.126:34873)
0805 22:57:12.989912 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:12.989917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:12.990303 (+ 386us) server_negotiation.cc:407] Connection header received
0805 22:57:12.990460 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:12.990464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:12.990531 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:12.990620 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:12.992126 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.992885 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.994339 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:12.994771 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:12.994869 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:12.997750 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:12.997756 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:12.997760 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:12.997797 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:13.000566 (+ 2769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:13.001203 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:13.001207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:13.001209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:13.001333 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:13.001833 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:13.001836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:13.001838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:13.002173 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:13.002356 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.002671 (+ 315us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.002849 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260805 22:57:13.007454 8779 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:57:13.015244 8779 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:57:13.053596 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.029751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46222 (local address 127.20.34.67:35041)
0805 22:57:13.045047 (+ 15296us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.045064 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.045107 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:57:13.045245 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.045255 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.045575 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.045826 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:13.047326 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.048882 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.051029 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.052277 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.052416 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.052665 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.052963 (+ 298us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.053158 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15098,"thread_start_us":14910,"threads_started":1}
I20260805 22:57:13.054672 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.028733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43210 (local address 127.20.34.65:34891)
0805 22:57:13.045473 (+ 16740us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.045480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.045508 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:57:13.045600 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.045610 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.045836 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.046228 (+ 392us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:13.046929 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.048619 (+ 1690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.051687 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.053106 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.053239 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.053464 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.054203 (+ 739us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.054382 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16570,"thread_start_us":17370,"threads_started":1}
I20260805 22:57:13.054754 9479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.029031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:35041 (local address 127.0.0.1:46222)
0805 22:57:13.038404 (+ 9373us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:13.038458 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:13.038637 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:13.045859 (+ 7222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:13.045867 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:13.045902 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:13.047112 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.047128 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.049015 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.049027 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.050835 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.050848 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.052461 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.052467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.052671 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.052734 (+ 63us) client_negotiation.cc:769] Sending connection context
0805 22:57:13.052884 (+ 150us) client_negotiation.cc:240] Negotiation successful
0805 22:57:13.054418 (+ 1534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9167,"mutex_wait_us":85,"thread_start_us":1242,"threads_started":1}
I20260805 22:57:13.055249 9477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.028555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43210)
0805 22:57:13.029876 (+ 1321us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:13.029933 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:13.030148 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:13.046099 (+ 15951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:13.046106 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:13.046138 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:13.046697 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.046712 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.048812 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.048817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.051512 (+ 2695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.051528 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.053593 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.053599 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.053782 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.053811 (+ 29us) client_negotiation.cc:769] Sending connection context
0805 22:57:13.053902 (+ 91us) client_negotiation.cc:240] Negotiation successful
0805 22:57:13.054104 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":994,"mutex_wait_us":198,"thread_start_us":15051,"threads_started":1}
I20260805 22:57:13.056213 9472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.031252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:45927 (local address 127.0.0.1:44628)
0805 22:57:13.043434 (+ 12182us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:13.043463 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:13.043964 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:13.046288 (+ 2324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:13.046293 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:13.046325 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:13.046841 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.046856 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.048710 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.048716 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.051537 (+ 2821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.051547 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.055412 (+ 3865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.055420 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.055582 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.055620 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 22:57:13.055716 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 22:57:13.055862 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12028,"mutex_wait_us":170,"thread_start_us":7830,"threads_started":1}
I20260805 22:57:13.056831 9483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.031592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44628 (local address 127.20.34.66:45927)
0805 22:57:13.045618 (+ 14026us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.045625 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.045649 (+ 24us) server_negotiation.cc:407] Connection header received
0805 22:57:13.045729 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.045773 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.046033 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.046411 (+ 378us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:13.047046 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.048585 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.052281 (+ 3696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.053822 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.053975 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.054155 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.056242 (+ 2087us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.056474 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13855,"thread_start_us":13682,"threads_started":1}
I20260805 22:57:13.059023 9361 tablet_service.cc:1467] Processing CreateTablet for tablet d5e84abd37a041f79a4fea7c6764a092 (DEFAULT_TABLE table=test-table [id=43d923c02bb841168b24f081c76636cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:13.059244 8960 tablet_service.cc:1467] Processing CreateTablet for tablet d5e84abd37a041f79a4fea7c6764a092 (DEFAULT_TABLE table=test-table [id=43d923c02bb841168b24f081c76636cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:13.060659 8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e84abd37a041f79a4fea7c6764a092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:13.060665 9361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e84abd37a041f79a4fea7c6764a092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:13.060261 9154 tablet_service.cc:1467] Processing CreateTablet for tablet d5e84abd37a041f79a4fea7c6764a092 (DEFAULT_TABLE table=test-table [id=43d923c02bb841168b24f081c76636cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:13.061551 9154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e84abd37a041f79a4fea7c6764a092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:13.082731 9486 tablet_bootstrap.cc:492] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Bootstrap starting.
I20260805 22:57:13.085721 9487 tablet_bootstrap.cc:492] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Bootstrap starting.
I20260805 22:57:13.087462 9486 tablet_bootstrap.cc:654] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:13.088877 9486 log.cc:824] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:13.089426 9488 tablet_bootstrap.cc:492] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Bootstrap starting.
I20260805 22:57:13.090363 9487 tablet_bootstrap.cc:654] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:13.091807 9487 log.cc:824] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:13.092097 9486 tablet_bootstrap.cc:492] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: No bootstrap required, opened a new log
I20260805 22:57:13.092434 9486 ts_tablet_manager.cc:1397] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260805 22:57:13.093195 9488 tablet_bootstrap.cc:654] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:13.094568 9488 log.cc:824] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:13.095572 9487 tablet_bootstrap.cc:492] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: No bootstrap required, opened a new log
I20260805 22:57:13.095932 9487 ts_tablet_manager.cc:1397] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260805 22:57:13.099242 9488 tablet_bootstrap.cc:492] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: No bootstrap required, opened a new log
I20260805 22:57:13.099589 9488 ts_tablet_manager.cc:1397] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260805 22:57:13.100643 9486 raft_consensus.cc:348] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.101075 9486 raft_consensus.cc:374] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:13.101205 9486 raft_consensus.cc:729] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5180efcb3f5d4168bb8e6b5e4d827cec, State: Initialized, Role: FOLLOWER
I20260805 22:57:13.101892 9486 consensus_queue.cc:260] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.103060 9454 heartbeater.cc:503] Master 127.20.34.126:34873 was elected leader, sending a full tablet report...
I20260805 22:57:13.103798 9486 ts_tablet_manager.cc:1428] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260805 22:57:13.107087 9487 raft_consensus.cc:348] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.107583 9487 raft_consensus.cc:374] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:13.107679 9487 raft_consensus.cc:729] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df090b9997d74b82a1e0b3f8c450b5a7, State: Initialized, Role: FOLLOWER
I20260805 22:57:13.108505 9487 consensus_queue.cc:260] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.109910 9251 heartbeater.cc:503] Master 127.20.34.126:34873 was elected leader, sending a full tablet report...
I20260805 22:57:13.110594 9487 ts_tablet_manager.cc:1428] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260805 22:57:13.110734 9488 raft_consensus.cc:348] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.111215 9488 raft_consensus.cc:374] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:13.111387 9488 raft_consensus.cc:729] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60839f62b23f47ee84c632fda6801603, State: Initialized, Role: FOLLOWER
I20260805 22:57:13.112144 9488 consensus_queue.cc:260] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.114216 9488 ts_tablet_manager.cc:1428] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
W20260805 22:57:13.132975 9252 tablet.cc:2369] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:57:13.197854 9455 tablet.cc:2369] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:57:13.294036 9055 tablet.cc:2369] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:57:13.298916 9492 raft_consensus.cc:482] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:57:13.299227 9492 raft_consensus.cc:504] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.301272 9492 leader_election.cc:288] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60839f62b23f47ee84c632fda6801603 (127.20.34.65:34891), df090b9997d74b82a1e0b3f8c450b5a7 (127.20.34.66:45927)
I20260805 22:57:13.307950 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.301665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:33619 (local address 127.20.34.65:34891)
0805 22:57:13.301918 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.301927 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.302109 (+ 182us) server_negotiation.cc:407] Connection header received
0805 22:57:13.302456 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.302462 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.302546 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.302662 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:13.303105 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.303917 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.305915 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.306849 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.307046 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.307133 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.307463 (+ 330us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.307620 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260805 22:57:13.308005 9459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.301689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.20.34.67:33619)
0805 22:57:13.301977 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:13.302007 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:13.302226 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:13.302689 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:13.302694 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:13.302725 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:13.302943 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.302954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.304069 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.304076 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.305728 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.305742 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.307031 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.307037 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.307259 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.307287 (+ 28us) client_negotiation.cc:769] Sending connection context
0805 22:57:13.307437 (+ 150us) client_negotiation.cc:240] Negotiation successful
0805 22:57:13.307598 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":1}
I20260805 22:57:13.308218 9483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.302140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:37035 (local address 127.20.34.66:45927)
0805 22:57:13.302412 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.302419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.302905 (+ 486us) server_negotiation.cc:407] Connection header received
0805 22:57:13.303132 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.303135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.303194 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.303296 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:13.303855 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.304623 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.306396 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.307188 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.307389 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.307470 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.307770 (+ 300us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.307905 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260805 22:57:13.308398 9497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.301826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:45927 (local address 127.20.34.67:37035)
0805 22:57:13.302789 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:13.302805 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:13.302977 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:13.303313 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:13.303317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:13.303341 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:13.303679 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.303688 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.304785 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.304791 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.306218 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:13.306241 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.307434 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.307440 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:13.307600 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.307624 (+ 24us) client_negotiation.cc:769] Sending connection context
0805 22:57:13.307734 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 22:57:13.307872 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":848,"mutex_wait_us":46,"thread_start_us":608,"threads_started":1}
I20260805 22:57:13.309468 9182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e84abd37a041f79a4fea7c6764a092" candidate_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" is_pre_election: true
I20260805 22:57:13.309473 8985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e84abd37a041f79a4fea7c6764a092" candidate_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60839f62b23f47ee84c632fda6801603" is_pre_election: true
I20260805 22:57:13.310020 9182 raft_consensus.cc:2454] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5180efcb3f5d4168bb8e6b5e4d827cec in term 0.
I20260805 22:57:13.310040 8985 raft_consensus.cc:2454] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5180efcb3f5d4168bb8e6b5e4d827cec in term 0.
I20260805 22:57:13.310766 9282 leader_election.cc:302] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5180efcb3f5d4168bb8e6b5e4d827cec, df090b9997d74b82a1e0b3f8c450b5a7; no voters:
I20260805 22:57:13.311266 9492 raft_consensus.cc:2781] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:57:13.311408 9492 raft_consensus.cc:482] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:57:13.311489 9492 raft_consensus.cc:3037] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:13.314419 9492 raft_consensus.cc:504] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.315197 9492 leader_election.cc:288] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [CANDIDATE]: Term 1 election: Requested vote from peers 60839f62b23f47ee84c632fda6801603 (127.20.34.65:34891), df090b9997d74b82a1e0b3f8c450b5a7 (127.20.34.66:45927)
I20260805 22:57:13.315795 8985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e84abd37a041f79a4fea7c6764a092" candidate_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60839f62b23f47ee84c632fda6801603"
I20260805 22:57:13.315850 9182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e84abd37a041f79a4fea7c6764a092" candidate_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df090b9997d74b82a1e0b3f8c450b5a7"
I20260805 22:57:13.316052 8985 raft_consensus.cc:3037] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:13.316082 9182 raft_consensus.cc:3037] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:13.318572 9182 raft_consensus.cc:2454] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5180efcb3f5d4168bb8e6b5e4d827cec in term 1.
I20260805 22:57:13.318706 8985 raft_consensus.cc:2454] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5180efcb3f5d4168bb8e6b5e4d827cec in term 1.
I20260805 22:57:13.319139 9282 leader_election.cc:302] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5180efcb3f5d4168bb8e6b5e4d827cec, df090b9997d74b82a1e0b3f8c450b5a7; no voters:
I20260805 22:57:13.319594 9492 raft_consensus.cc:2781] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:57:13.320139 9492 raft_consensus.cc:686] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 LEADER]: Becoming Leader. State: Replica: 5180efcb3f5d4168bb8e6b5e4d827cec, State: Running, Role: LEADER
I20260805 22:57:13.320875 9492 consensus_queue.cc:237] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } }
I20260805 22:57:13.326022 8778 catalog_manager.cc:5495] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec reported cstate change: term changed from 0 to 1, leader changed from <none> to 5180efcb3f5d4168bb8e6b5e4d827cec (127.20.34.67). New cstate: current_term: 1 leader_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } health_report { overall_health: UNKNOWN } } }
I20260805 22:57:13.347800 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.341897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.20.34.67:35041)
0805 22:57:13.342124 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.342129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.342149 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:57:13.342305 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.342309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.342398 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.342538 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:57:13.342923 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.343676 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.345412 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.345822 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.345948 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.346556 (+ 608us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:57:13.347135 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:57:13.347259 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.347390 (+ 131us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.347473 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260805 22:57:13.356442 9182 raft_consensus.cc:1261] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 FOLLOWER]: Refusing update from remote peer 5180efcb3f5d4168bb8e6b5e4d827cec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:57:13.356525 8985 raft_consensus.cc:1261] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 1 FOLLOWER]: Refusing update from remote peer 5180efcb3f5d4168bb8e6b5e4d827cec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:57:13.357568 9498 consensus_queue.cc:1035] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:57:13.357918 9492 consensus_queue.cc:1035] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [LEADER]: Connected to new peer: Peer: permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:57:13.369730 9503 mvcc.cc:205] Tried to move back new op lower bound from 7315335714217287680 to 7315335714086629376. Current Snapshot: MvccSnapshot[applied={T|T < 7315335714217287680}]
I20260805 22:57:13.373474 9504 mvcc.cc:205] Tried to move back new op lower bound from 7315335714217287680 to 7315335714086629376. Current Snapshot: MvccSnapshot[applied={T|T < 7315335714217287680}]
I20260805 22:57:13.385422 8778 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:57:13.385783 8778 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:57:13.390308 8778 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Sending DeleteTablet for 3 replicas of tablet d5e84abd37a041f79a4fea7c6764a092
I20260805 22:57:13.391844 8960 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e84abd37a041f79a4fea7c6764a092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:13 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:43210
I20260805 22:57:13.392060 9361 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e84abd37a041f79a4fea7c6764a092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:13 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:46222
I20260805 22:57:13.393824 9154 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e84abd37a041f79a4fea7c6764a092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:13 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:44628
I20260805 22:57:13.401592 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 8871
I20260805 22:57:13.405951 9520 tablet_replica.cc:330] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: stopping tablet replica
I20260805 22:57:13.406791 9520 raft_consensus.cc:2229] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:57:13.407087 9515 tablet_replica.cc:330] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: stopping tablet replica
I20260805 22:57:13.407447 9520 raft_consensus.cc:2258] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:13.407806 9515 raft_consensus.cc:2229] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:57:13.408363 9518 tablet_replica.cc:330] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: stopping tablet replica
I20260805 22:57:13.408514 9515 raft_consensus.cc:2258] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:13.408890 9518 raft_consensus.cc:2229] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:57:13.409766 9518 raft_consensus.cc:2258] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:13.411422 9515 ts_tablet_manager.cc:1905] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:13.412247 9520 ts_tablet_manager.cc:1905] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:13.415637 9518 ts_tablet_manager.cc:1905] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:13.419535 9520 ts_tablet_manager.cc:1918] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:13.419787 9520 log.cc:1196] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/d5e84abd37a041f79a4fea7c6764a092
I20260805 22:57:13.419744 9515 ts_tablet_manager.cc:1918] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:13.420053 9515 log.cc:1196] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/d5e84abd37a041f79a4fea7c6764a092
I20260805 22:57:13.420585 9520 ts_tablet_manager.cc:1939] T d5e84abd37a041f79a4fea7c6764a092 P df090b9997d74b82a1e0b3f8c450b5a7: Deleting consensus metadata
I20260805 22:57:13.420799 9515 ts_tablet_manager.cc:1939] T d5e84abd37a041f79a4fea7c6764a092 P 60839f62b23f47ee84c632fda6801603: Deleting consensus metadata
I20260805 22:57:13.422714 8760 catalog_manager.cc:4841] TS df090b9997d74b82a1e0b3f8c450b5a7 (127.20.34.66:45927): tablet d5e84abd37a041f79a4fea7c6764a092 (table test-table [id=43d923c02bb841168b24f081c76636cf]) successfully deleted
I20260805 22:57:13.422777 8762 catalog_manager.cc:4841] TS 60839f62b23f47ee84c632fda6801603 (127.20.34.65:34891): tablet d5e84abd37a041f79a4fea7c6764a092 (table test-table [id=43d923c02bb841168b24f081c76636cf]) successfully deleted
I20260805 22:57:13.426271 9518 ts_tablet_manager.cc:1918] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:13.426493 9518 log.cc:1196] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/d5e84abd37a041f79a4fea7c6764a092
I20260805 22:57:13.427050 9518 ts_tablet_manager.cc:1939] T d5e84abd37a041f79a4fea7c6764a092 P 5180efcb3f5d4168bb8e6b5e4d827cec: Deleting consensus metadata
Aug 05 22:57:13 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:57:13.428790 8760 catalog_manager.cc:4841] TS 5180efcb3f5d4168bb8e6b5e4d827cec (127.20.34.67:35041): tablet d5e84abd37a041f79a4fea7c6764a092 (table test-table [id=43d923c02bb841168b24f081c76636cf]) successfully deleted
I20260805 22:57:13.436129 9473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.403187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43214 (local address 127.20.34.65:34891)
0805 22:57:13.403410 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.403417 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.405053 (+ 1636us) server_negotiation.cc:407] Connection header received
0805 22:57:13.405345 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.405351 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.405471 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.405600 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:13.412319 (+ 6719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.413544 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.420805 (+ 7261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.421536 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.421654 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.428739 (+ 7085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:13.428762 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:13.428785 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:13.428838 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:13.432786 (+ 3948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:13.433647 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:13.433657 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:13.433661 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:13.433843 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:13.434217 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:13.434222 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:13.434226 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:13.434760 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:13.435084 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.435274 (+ 190us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.435721 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 22:57:13.436913 9048 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:13.529820 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 8871
I20260805 22:57:13.561517 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 9061
Aug 05 22:57:13 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:57:13.588788 9483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.562468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44638 (local address 127.20.34.66:45927)
0805 22:57:13.562671 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.562677 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.562699 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:57:13.562800 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.562806 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.562880 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.562989 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:13.564340 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.565101 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.566512 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.566910 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.567041 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.578061 (+ 11020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:13.578082 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:13.578100 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:13.578153 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:13.585284 (+ 7131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:13.586404 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:13.586413 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:13.586416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:13.586556 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:13.587018 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:13.587023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:13.587026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:13.587599 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:13.587966 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.588307 (+ 341us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.588495 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:57:13.589751 9244 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:13.682674 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 9061
I20260805 22:57:13.714305 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 9258
Aug 05 22:57:13 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:57:13.734344 9478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:13.715247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46230 (local address 127.20.34.67:35041)
0805 22:57:13.715454 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:13.715459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:13.715540 (+ 81us) server_negotiation.cc:407] Connection header received
0805 22:57:13.715772 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:13.715776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:13.715860 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:13.715970 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:13.717849 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.718681 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.720708 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:13.721216 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:13.721322 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:13.727094 (+ 5772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:13.727118 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:13.727137 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:13.727191 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:13.730553 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:13.731383 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:13.731392 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:13.731395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:13.731581 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:13.732015 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:13.732020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:13.732024 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:13.732604 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:13.733010 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:13.733614 (+ 604us) server_negotiation.cc:299] Negotiation successful
0805 22:57:13.733872 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 22:57:13.735219 9445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:13.864797 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 9258
I20260805 22:57:13.890589 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 8741
I20260805 22:57:13.891871 8830 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:14.007733 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 8741
I20260805 22:57:14.039064 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34873
--webserver_interface=127.20.34.126
--webserver_port=40763
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:34873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:14.409780 9529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:14.410200 9529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:14.410378 9529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:14.418061 9529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:14.418258 9529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:14.418381 9529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:14.418514 9529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:14.418607 9529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:14.429206 9529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:34873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=40763
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:14.430779 9529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:14.432250 9529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:14.461318 9538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:14.461436 9542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:14.461407 9539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:14.462299 9529 server_base.cc:1034] running on GCE node
I20260805 22:57:14.463341 9529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:14.465179 9529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:14.466482 9529 hybrid_clock.cc:648] HybridClock initialized: now 1785970634466401 us; error 54 us; skew 500 ppm
I20260805 22:57:14.466989 9529 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:14 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970634, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:14.471426 9529 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:57:14.473395 9529 webserver.cc:460] Webserver started at http://127.20.34.126:40763/ using document root <none> and password file <none>
I20260805 22:57:14.474287 9529 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:14.474488 9529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:14.481596 9529 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260805 22:57:14.485037 9551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:14.486706 9529 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:57:14.486936 9529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "b8a26049955642a2bf9af7ab034c06a9"
format_stamp: "Formatted at 2026-08-05 22:57:10 on dist-test-slave-gmjp"
server_key: "1cff11c5d13acc245e41dbb83057fff0"
server_key_iv: "4ede06ca4b566698cb5b3996e8ab454e"
server_key_version: "encryptionkey@0"
I20260805 22:57:14.488287 9529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:14.525707 9529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:14.530833 9529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:14.531185 9529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:14.552459 9529 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:34873
I20260805 22:57:14.552481 9619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:34873 every 8 connection(s)
I20260805 22:57:14.554230 9529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:57:14.562321 9620 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:57:14.563624 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 9529
I20260805 22:57:14.564770 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:34891
--local_ip_for_outbound_sockets=127.20.34.65
--tserver_master_addrs=127.20.34.126:34873
--webserver_port=36315
--webserver_interface=127.20.34.65
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:57:14.568019 9620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Bootstrap starting.
I20260805 22:57:14.592849 9620 log.cc:824] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:14.606199 9620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:57:14.606807 9620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Bootstrap complete.
I20260805 22:57:14.616920 9620 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:14.617861 9620 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8a26049955642a2bf9af7ab034c06a9, State: Initialized, Role: FOLLOWER
I20260805 22:57:14.618603 9620 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:14.618885 9620 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:57:14.619035 9620 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:57:14.619232 9620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:57:14.623577 9620 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:14.624261 9620 leader_election.cc:302] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8a26049955642a2bf9af7ab034c06a9; no voters:
I20260805 22:57:14.624963 9620 leader_election.cc:288] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:57:14.625115 9628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:57:14.626502 9628 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 2 LEADER]: Becoming Leader. State: Replica: b8a26049955642a2bf9af7ab034c06a9, State: Running, Role: LEADER
I20260805 22:57:14.627200 9628 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:14.627584 9620 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:57:14.630326 9632 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a26049955642a2bf9af7ab034c06a9. Latest consensus state: current_term: 2 leader_uuid: "b8a26049955642a2bf9af7ab034c06a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } } }
I20260805 22:57:14.630859 9632 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:14.631640 9630 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b8a26049955642a2bf9af7ab034c06a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } } }
I20260805 22:57:14.632015 9630 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:14.641451 9639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:57:14.652787 9639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:57:14.654757 9639 catalog_manager.cc:1259] Loaded cluster ID: 690b2fad85254217b670410c67c00a9c
I20260805 22:57:14.654961 9639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:57:14.659612 9639 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260805 22:57:14.687040 9639 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260805 22:57:14.715579 9639 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:57:14.718562 9639 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Loaded TSK: 0
I20260805 22:57:14.720728 9639 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:57:14.989460 9625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:14.989885 9625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:14.990069 9625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:14.998693 9625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:14.998893 9625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:14.999085 9625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:57:15.010130 9625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:34891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=36315
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:15.011783 9625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:15.013573 9625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:15.031587 9661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:15.031731 9664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:15.032379 9625 server_base.cc:1034] running on GCE node
W20260805 22:57:15.032488 9660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:15.033322 9625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:15.034389 9625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:15.035702 9625 hybrid_clock.cc:648] HybridClock initialized: now 1785970635035466 us; error 227 us; skew 500 ppm
I20260805 22:57:15.036062 9625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:15 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970635, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:15.039549 9625 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:57:15.041395 9625 webserver.cc:460] Webserver started at http://127.20.34.65:36315/ using document root <none> and password file <none>
I20260805 22:57:15.042191 9625 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:15.042371 9625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:15.048563 9625 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260805 22:57:15.051676 9672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:15.053246 9625 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:57:15.053452 9625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "60839f62b23f47ee84c632fda6801603"
format_stamp: "Formatted at 2026-08-05 22:57:11 on dist-test-slave-gmjp"
server_key: "47947ef04bc1f9b87bf6ae2085016849"
server_key_iv: "3d396b5cd7fb848bf4ce177c60d91163"
server_key_version: "encryptionkey@0"
I20260805 22:57:15.054513 9625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:15.077446 9625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:15.082358 9625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:15.082679 9625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:15.083880 9625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:15.085379 9625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:15.085508 9625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:15.085654 9625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:15.085755 9625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:15.121644 9625 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34891
I20260805 22:57:15.121737 9825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34891 every 8 connection(s)
I20260805 22:57:15.123194 9625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:57:15.125068 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 9625
I20260805 22:57:15.125818 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:45927
--local_ip_for_outbound_sockets=127.20.34.66
--tserver_master_addrs=127.20.34.126:34873
--webserver_port=33235
--webserver_interface=127.20.34.66
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:57:15 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970635, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:15.153904 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:15.126707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:52441)
0805 22:57:15.127598 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:15.127659 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:15.130382 (+ 2723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:15.132869 (+ 2487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:15.132877 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:15.133427 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:15.133982 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:15.134002 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:15.136526 (+ 2524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:15.136530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:15.137791 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:15.137806 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:15.139386 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:15.139392 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:15.139599 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:15.140422 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:15.140454 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:15.143557 (+ 3103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:15.148856 (+ 5299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:15.148865 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:15.148880 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:15.149448 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:15.150129 (+ 681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:15.150133 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:15.150136 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:15.150376 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:15.151504 (+ 1128us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:15.151511 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:15.151858 (+ 347us) client_negotiation.cc:769] Sending connection context
0805 22:57:15.152116 (+ 258us) client_negotiation.cc:240] Negotiation successful
0805 22:57:15.152658 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":476,"threads_started":1}
I20260805 22:57:15.154258 9831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:15.127564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:52441 (local address 127.20.34.126:34873)
0805 22:57:15.131264 (+ 3700us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:15.131283 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:15.131336 (+ 53us) server_negotiation.cc:407] Connection header received
0805 22:57:15.131737 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:15.131758 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:15.132284 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:15.132728 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:15.134245 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:15.136345 (+ 2100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:15.137957 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:15.139103 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:15.139303 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:15.143946 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:15.143962 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:15.143990 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:15.144064 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:15.148641 (+ 4577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:15.149635 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:15.149650 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:15.149662 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:15.149949 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:15.150515 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:15.150523 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:15.150528 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:15.151317 (+ 789us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:15.151516 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:15.152466 (+ 950us) server_negotiation.cc:299] Negotiation successful
0805 22:57:15.152998 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3437,"thread_start_us":3301,"threads_started":1}
I20260805 22:57:15.157296 9826 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34873
I20260805 22:57:15.157689 9826 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:15.158823 9826 heartbeater.cc:511] Master 127.20.34.126:34873 requested a full tablet report, sending...
I20260805 22:57:15.161550 9572 ts_manager.cc:194] Registered new tserver with Master: 60839f62b23f47ee84c632fda6801603 (127.20.34.65:34891)
I20260805 22:57:15.163069 9572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:52441
W20260805 22:57:15.522071 9833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:15.522403 9833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:15.522567 9833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:15.530467 9833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:15.530611 9833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:15.530836 9833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:57:15.541194 9833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:45927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=33235
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:15.542698 9833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:15.544258 9833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:15.559510 9844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:15.559846 9846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:15.559556 9843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:15.561259 9833 server_base.cc:1034] running on GCE node
I20260805 22:57:15.562055 9833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:15.563159 9833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:15.564415 9833 hybrid_clock.cc:648] HybridClock initialized: now 1785970635564355 us; error 56 us; skew 500 ppm
I20260805 22:57:15.564780 9833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:15 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970635, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:15.568454 9833 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:57:15.570199 9833 webserver.cc:460] Webserver started at http://127.20.34.66:33235/ using document root <none> and password file <none>
I20260805 22:57:15.570996 9833 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:15.571173 9833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:15.577419 9833 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:57:15.580602 9856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:15.582088 9833 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260805 22:57:15.582300 9833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "df090b9997d74b82a1e0b3f8c450b5a7"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "fdc9d3d3e1b42db2121d9739bd0779c0"
server_key_iv: "e239aa1cca70ef44e891da5ba53fbe48"
server_key_version: "encryptionkey@0"
I20260805 22:57:15.583407 9833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:15.603353 9833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:15.608283 9833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:15.608608 9833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:15.609776 9833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:15.611358 9833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:15.611495 9833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:15.611654 9833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:15.611757 9833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:15.648733 9833 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:45927
I20260805 22:57:15.648830 10018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:45927 every 8 connection(s)
I20260805 22:57:15.650341 9833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:57:15.653852 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 9833
I20260805 22:57:15.654493 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:35041
--local_ip_for_outbound_sockets=127.20.34.67
--tserver_master_addrs=127.20.34.126:34873
--webserver_port=34859
--webserver_interface=127.20.34.67
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:57:15 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970635, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:15.674693 9831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:15.653378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:48651 (local address 127.20.34.126:34873)
0805 22:57:15.653614 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:15.653623 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:15.654950 (+ 1327us) server_negotiation.cc:407] Connection header received
0805 22:57:15.657038 (+ 2088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:15.657046 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:15.657189 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:15.657314 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:15.659503 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:15.660710 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:15.662521 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:15.663302 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:15.663466 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:15.667873 (+ 4407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:15.667878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:15.667882 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:15.667922 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:15.670748 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:15.671941 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:15.671946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:15.671948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:15.672087 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:15.672693 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:15.672697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:15.672700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:15.673056 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:15.673190 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:15.674221 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0805 22:57:15.674433 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 22:57:15.676535 10023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:15.653831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:48651)
0805 22:57:15.654757 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:15.654821 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:15.656723 (+ 1902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:15.657633 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:15.657643 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:15.658468 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:15.659228 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:15.659254 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:15.660939 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:15.660943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:15.662344 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:15.662358 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:15.663598 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:15.663604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:15.663912 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:15.664895 (+ 983us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:15.664921 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:15.667578 (+ 2657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:15.670951 (+ 3373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:15.670964 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:15.670989 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:15.671806 (+ 817us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:15.672223 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:15.672231 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:15.672237 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:15.672518 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:15.673228 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:15.673240 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:15.673760 (+ 520us) client_negotiation.cc:769] Sending connection context
0805 22:57:15.674111 (+ 351us) client_negotiation.cc:240] Negotiation successful
0805 22:57:15.674760 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":398,"threads_started":1}
I20260805 22:57:15.678377 10020 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34873
I20260805 22:57:15.678815 10020 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:15.679692 10020 heartbeater.cc:511] Master 127.20.34.126:34873 requested a full tablet report, sending...
I20260805 22:57:15.681457 9572 ts_manager.cc:194] Registered new tserver with Master: df090b9997d74b82a1e0b3f8c450b5a7 (127.20.34.66:45927)
I20260805 22:57:15.682315 9572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:48651
W20260805 22:57:16.021730 10024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:16.022113 10024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:16.022289 10024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:16.030597 10024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:16.030789 10024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:16.030984 10024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:57:16.041872 10024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:35041
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=34859
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:16.043412 10024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:16.045006 10024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:16.060045 10029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:16.060067 10036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:16.060006 10031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:16.061600 10024 server_base.cc:1034] running on GCE node
I20260805 22:57:16.062336 10024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:16.063383 10024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:16.064601 10024 hybrid_clock.cc:648] HybridClock initialized: now 1785970636064558 us; error 33 us; skew 500 ppm
I20260805 22:57:16.064996 10024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:16 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970636, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:16.068413 10024 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:57:16.070004 10024 webserver.cc:460] Webserver started at http://127.20.34.67:34859/ using document root <none> and password file <none>
I20260805 22:57:16.070750 10024 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:16.070950 10024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:16.076773 10024 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:57:16.079680 10046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:16.081452 10024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:57:16.081661 10024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "5180efcb3f5d4168bb8e6b5e4d827cec"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "c4032e507bb654f3e6ed436a72b7b91c"
server_key_iv: "faa088676f1fb86b1b2d3b4d4286b5a8"
server_key_version: "encryptionkey@0"
I20260805 22:57:16.082717 10024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:16.101284 10024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:16.105605 10024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:16.105908 10024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:16.106982 10024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:16.108371 10024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:16.108497 10024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:16.108636 10024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:16.108743 10024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:16.145305 10024 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:35041
I20260805 22:57:16.145398 10223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:35041 every 8 connection(s)
I20260805 22:57:16.146853 10024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:57:16.153497 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 10024
Aug 05 22:57:16 dist-test-slave-gmjp krb5kdc[8725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970636, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:16.167260 9826 heartbeater.cc:503] Master 127.20.34.126:34873 was elected leader, sending a full tablet report...
I20260805 22:57:16.170804 9831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.149496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:51219 (local address 127.20.34.126:34873)
0805 22:57:16.149695 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.149699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.150824 (+ 1125us) server_negotiation.cc:407] Connection header received
0805 22:57:16.152714 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.152719 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.152790 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.152881 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:16.154506 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.155597 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.158367 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.159165 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.159288 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.163542 (+ 4254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:16.163551 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:16.163557 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:16.163599 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:16.167239 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.168271 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.168276 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.168278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.168398 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.168869 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.168874 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.168878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.169266 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:16.169419 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.170171 (+ 752us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.170395 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":75}
I20260805 22:57:16.172096 10230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.154497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51174 (local address 127.20.34.126:34873)
0805 22:57:16.155014 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.155020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.155396 (+ 376us) server_negotiation.cc:407] Connection header received
0805 22:57:16.155547 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.155551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.155626 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.155733 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:16.158176 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.159444 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.161430 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.161853 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.162000 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.165625 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:16.165634 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:16.165643 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:16.165705 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:16.169134 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.170010 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.170015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.170019 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.170139 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.170549 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.170554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.170558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.170878 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:16.171152 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.171601 (+ 449us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.171771 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":407,"thread_start_us":314,"threads_started":1}
I20260805 22:57:16.172118 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.149927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:51219)
0805 22:57:16.150643 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.150681 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:16.152453 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:16.153092 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:16.153100 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:16.153678 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:16.154305 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.154331 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.155828 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.155833 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.158203 (+ 2370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.158217 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.159379 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.159385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.159679 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.160494 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:16.160524 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:16.163290 (+ 2766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:16.167430 (+ 4140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:16.167440 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:16.167460 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:16.168088 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:16.168522 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:16.168529 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:16.168533 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:16.168739 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:16.169405 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:16.169413 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:16.169779 (+ 366us) client_negotiation.cc:769] Sending connection context
0805 22:57:16.170070 (+ 291us) client_negotiation.cc:240] Negotiation successful
0805 22:57:16.170667 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":278,"threads_started":1}
I20260805 22:57:16.173532 10225 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34873
I20260805 22:57:16.173875 10225 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:16.174736 10225 heartbeater.cc:511] Master 127.20.34.126:34873 requested a full tablet report, sending...
I20260805 22:57:16.176057 9572 ts_manager.cc:194] Registered new tserver with Master: 5180efcb3f5d4168bb8e6b5e4d827cec (127.20.34.67:35041)
I20260805 22:57:16.176887 9572 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:51219
I20260805 22:57:16.187464 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:57:16.194537 10230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.188585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51186 (local address 127.20.34.126:34873)
0805 22:57:16.188795 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.188801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.189295 (+ 494us) server_negotiation.cc:407] Connection header received
0805 22:57:16.189490 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.189494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.189650 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.189782 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:57:16.190237 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.190921 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.192440 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.192862 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.192951 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.193433 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:57:16.193950 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:57:16.194058 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.194253 (+ 195us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.194321 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 22:57:16.195569 9572 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:51186:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:57:16.203039 9572 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:57:16.228552 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.215561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43218 (local address 127.20.34.65:34891)
0805 22:57:16.216849 (+ 1288us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.216861 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.217447 (+ 586us) server_negotiation.cc:407] Connection header received
0805 22:57:16.217935 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.217944 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.218212 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.218379 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:16.219652 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.221258 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.224429 (+ 3171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.226037 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.226159 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.226447 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.227696 (+ 1249us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.227976 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1100,"thread_start_us":932,"threads_started":1}
I20260805 22:57:16.229434 10243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.217858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:35041 (local address 127.0.0.1:46240)
0805 22:57:16.218662 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.218693 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:16.218853 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:16.220233 (+ 1380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:16.220237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:16.220262 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:16.220615 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.220626 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.223377 (+ 2751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.223383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.226283 (+ 2900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.226297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.228443 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.228451 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.228640 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.228675 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 22:57:16.228784 (+ 109us) client_negotiation.cc:240] Negotiation successful
0805 22:57:16.229018 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"spinlock_wait_cycles":2304,"thread_start_us":742,"threads_started":1}
I20260805 22:57:16.230464 10246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.218420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46240 (local address 127.20.34.67:35041)
0805 22:57:16.219616 (+ 1196us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.219623 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.219654 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:57:16.219751 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.219761 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.220002 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.220235 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:16.220827 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.223217 (+ 2390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.226540 (+ 3323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.228140 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.229566 (+ 1426us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.229831 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.229913 (+ 82us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.230105 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1039,"thread_start_us":860,"threads_started":1}
I20260805 22:57:16.231467 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.215169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43218)
0805 22:57:16.217261 (+ 2092us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.217306 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:16.217647 (+ 341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:16.218755 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:16.218762 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:16.218806 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:16.219328 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.219349 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.221454 (+ 2105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.221462 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.224200 (+ 2738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.224216 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.226829 (+ 2613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.226838 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.227178 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.227268 (+ 90us) client_negotiation.cc:769] Sending connection context
0805 22:57:16.229160 (+ 1892us) client_negotiation.cc:240] Negotiation successful
0805 22:57:16.229311 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1838,"mutex_wait_us":2,"spinlock_wait_cycles":4480,"thread_start_us":1676,"threads_started":1}
I20260805 22:57:16.231935 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.216349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44652 (local address 127.20.34.66:45927)
0805 22:57:16.217286 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.217296 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.217880 (+ 584us) server_negotiation.cc:407] Connection header received
0805 22:57:16.218166 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.218174 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.218378 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.218552 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:16.219733 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.221729 (+ 1996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.227844 (+ 6115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.230043 (+ 2199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.230188 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.230501 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.231272 (+ 771us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.231503 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":630,"threads_started":1}
I20260805 22:57:16.232911 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.215670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:45927 (local address 127.0.0.1:44652)
0805 22:57:16.217772 (+ 2102us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.217798 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:16.217993 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:16.219020 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:16.219024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:16.219045 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:16.219557 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.219570 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.222092 (+ 2522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.222128 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.227589 (+ 5461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.227608 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.230738 (+ 3130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.230748 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.231007 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.231062 (+ 55us) client_negotiation.cc:769] Sending connection context
0805 22:57:16.232193 (+ 1131us) client_negotiation.cc:240] Negotiation successful
0805 22:57:16.232389 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1968,"mutex_wait_us":100,"thread_start_us":1818,"threads_started":1}
I20260805 22:57:16.235284 10131 tablet_service.cc:1467] Processing CreateTablet for tablet c1e496100e2044c597b825cbaada3a78 (DEFAULT_TABLE table=test-table [id=9e3456bbfd1b42dbb0ca0045a92d8c94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:16.236958 10131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1e496100e2044c597b825cbaada3a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:16.236979 9740 tablet_service.cc:1467] Processing CreateTablet for tablet c1e496100e2044c597b825cbaada3a78 (DEFAULT_TABLE table=test-table [id=9e3456bbfd1b42dbb0ca0045a92d8c94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:16.237063 9924 tablet_service.cc:1467] Processing CreateTablet for tablet c1e496100e2044c597b825cbaada3a78 (DEFAULT_TABLE table=test-table [id=9e3456bbfd1b42dbb0ca0045a92d8c94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:16.238241 9740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1e496100e2044c597b825cbaada3a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:16.238477 9924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1e496100e2044c597b825cbaada3a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:16.250902 10248 tablet_bootstrap.cc:492] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Bootstrap starting.
I20260805 22:57:16.253226 10249 tablet_bootstrap.cc:492] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Bootstrap starting.
I20260805 22:57:16.254928 10248 tablet_bootstrap.cc:654] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:16.256027 10250 tablet_bootstrap.cc:492] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Bootstrap starting.
I20260805 22:57:16.256341 10248 log.cc:824] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:16.257099 10249 tablet_bootstrap.cc:654] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:16.258494 10249 log.cc:824] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:16.260667 10250 tablet_bootstrap.cc:654] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:16.260896 10248 tablet_bootstrap.cc:492] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: No bootstrap required, opened a new log
I20260805 22:57:16.261222 10248 ts_tablet_manager.cc:1397] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260805 22:57:16.261610 10249 tablet_bootstrap.cc:492] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: No bootstrap required, opened a new log
I20260805 22:57:16.261917 10249 ts_tablet_manager.cc:1397] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260805 22:57:16.262086 10250 log.cc:824] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:16.265576 10250 tablet_bootstrap.cc:492] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: No bootstrap required, opened a new log
I20260805 22:57:16.265868 10250 ts_tablet_manager.cc:1397] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260805 22:57:16.270432 10249 raft_consensus.cc:348] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.270826 10249 raft_consensus.cc:374] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:16.270973 10249 raft_consensus.cc:729] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5180efcb3f5d4168bb8e6b5e4d827cec, State: Initialized, Role: FOLLOWER
I20260805 22:57:16.271620 10249 consensus_queue.cc:260] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.272073 10248 raft_consensus.cc:348] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.272660 10248 raft_consensus.cc:374] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:16.272770 10248 raft_consensus.cc:729] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60839f62b23f47ee84c632fda6801603, State: Initialized, Role: FOLLOWER
I20260805 22:57:16.272831 10225 heartbeater.cc:503] Master 127.20.34.126:34873 was elected leader, sending a full tablet report...
I20260805 22:57:16.273391 10248 consensus_queue.cc:260] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.275007 10249 ts_tablet_manager.cc:1428] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260805 22:57:16.275208 10248 ts_tablet_manager.cc:1428] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260805 22:57:16.277942 10250 raft_consensus.cc:348] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.278496 10250 raft_consensus.cc:374] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:16.278653 10250 raft_consensus.cc:729] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df090b9997d74b82a1e0b3f8c450b5a7, State: Initialized, Role: FOLLOWER
I20260805 22:57:16.279336 10250 consensus_queue.cc:260] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.280645 10020 heartbeater.cc:503] Master 127.20.34.126:34873 was elected leader, sending a full tablet report...
I20260805 22:57:16.281068 10250 ts_tablet_manager.cc:1428] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260805 22:57:16.375918 9829 tablet.cc:2369] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:57:16.398650 10226 tablet.cc:2369] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:57:16.402632 10021 tablet.cc:2369] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:57:16.406119 10256 raft_consensus.cc:482] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:57:16.406435 10256 raft_consensus.cc:504] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.408268 10256 leader_election.cc:288] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60839f62b23f47ee84c632fda6801603 (127.20.34.65:34891), 5180efcb3f5d4168bb8e6b5e4d827cec (127.20.34.67:35041)
I20260805 22:57:16.415406 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.408687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:58465 (local address 127.20.34.65:34891)
0805 22:57:16.408943 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.408951 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.409793 (+ 842us) server_negotiation.cc:407] Connection header received
0805 22:57:16.410042 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.410047 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.410115 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.410214 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:16.410881 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.411613 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.413613 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.414399 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.414608 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.414690 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.414979 (+ 289us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.415112 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:57:16.415560 10257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.408714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.20.34.66:58465)
0805 22:57:16.409650 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.409667 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:16.409868 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:16.410246 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:16.410251 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:16.410277 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:16.410714 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.410725 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.411750 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.411758 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.413442 (+ 1684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.413458 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.414628 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.414634 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.414793 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.414818 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:57:16.414942 (+ 124us) client_negotiation.cc:240] Negotiation successful
0805 22:57:16.415090 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":771,"mutex_wait_us":22,"spinlock_wait_cycles":37248,"thread_start_us":531,"threads_started":1}
I20260805 22:57:16.415833 10246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.408852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:49043 (local address 127.20.34.67:35041)
0805 22:57:16.409100 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.409109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.409843 (+ 734us) server_negotiation.cc:407] Connection header received
0805 22:57:16.410057 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.410061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.410125 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.410232 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:16.410950 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.411674 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.413661 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.414674 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.414969 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.415045 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.415397 (+ 352us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.415543 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260805 22:57:16.415998 10258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.408802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:35041 (local address 127.20.34.66:49043)
0805 22:57:16.409723 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.409738 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:16.409904 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:16.410246 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:16.410251 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:16.410350 (+ 99us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:16.410774 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.410792 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.411831 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.411837 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.413494 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:16.413507 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.414995 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.415001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:16.415164 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.415188 (+ 24us) client_negotiation.cc:769] Sending connection context
0805 22:57:16.415368 (+ 180us) client_negotiation.cc:240] Negotiation successful
0805 22:57:16.415522 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"mutex_wait_us":50,"spinlock_wait_cycles":28928,"thread_start_us":552,"threads_started":1}
I20260805 22:57:16.416996 9765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e496100e2044c597b825cbaada3a78" candidate_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60839f62b23f47ee84c632fda6801603" is_pre_election: true
I20260805 22:57:16.417088 10156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e496100e2044c597b825cbaada3a78" candidate_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" is_pre_election: true
I20260805 22:57:16.417594 10156 raft_consensus.cc:2454] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df090b9997d74b82a1e0b3f8c450b5a7 in term 0.
I20260805 22:57:16.417578 9765 raft_consensus.cc:2454] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df090b9997d74b82a1e0b3f8c450b5a7 in term 0.
I20260805 22:57:16.418303 9859 leader_election.cc:302] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5180efcb3f5d4168bb8e6b5e4d827cec, 60839f62b23f47ee84c632fda6801603, df090b9997d74b82a1e0b3f8c450b5a7; no voters:
I20260805 22:57:16.418762 10256 raft_consensus.cc:2781] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:57:16.418923 10256 raft_consensus.cc:482] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:57:16.419030 10256 raft_consensus.cc:3037] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:16.421617 10256 raft_consensus.cc:504] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.422257 10256 leader_election.cc:288] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [CANDIDATE]: Term 1 election: Requested vote from peers 60839f62b23f47ee84c632fda6801603 (127.20.34.65:34891), 5180efcb3f5d4168bb8e6b5e4d827cec (127.20.34.67:35041)
I20260805 22:57:16.422711 9765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e496100e2044c597b825cbaada3a78" candidate_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60839f62b23f47ee84c632fda6801603"
I20260805 22:57:16.422806 10156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1e496100e2044c597b825cbaada3a78" candidate_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec"
I20260805 22:57:16.423008 10156 raft_consensus.cc:3037] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:16.422998 9765 raft_consensus.cc:3037] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:16.426481 9765 raft_consensus.cc:2454] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df090b9997d74b82a1e0b3f8c450b5a7 in term 1.
I20260805 22:57:16.426483 10156 raft_consensus.cc:2454] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df090b9997d74b82a1e0b3f8c450b5a7 in term 1.
I20260805 22:57:16.427081 9858 leader_election.cc:302] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5180efcb3f5d4168bb8e6b5e4d827cec, 60839f62b23f47ee84c632fda6801603, df090b9997d74b82a1e0b3f8c450b5a7; no voters:
I20260805 22:57:16.427534 10256 raft_consensus.cc:2781] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:57:16.428095 10256 raft_consensus.cc:686] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 LEADER]: Becoming Leader. State: Replica: df090b9997d74b82a1e0b3f8c450b5a7, State: Running, Role: LEADER
I20260805 22:57:16.428763 10256 consensus_queue.cc:237] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } }
I20260805 22:57:16.433454 9572 catalog_manager.cc:5495] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to df090b9997d74b82a1e0b3f8c450b5a7 (127.20.34.66). New cstate: current_term: 1 leader_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df090b9997d74b82a1e0b3f8c450b5a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 45927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 } health_report { overall_health: UNKNOWN } } }
I20260805 22:57:16.479496 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.473745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44662 (local address 127.20.34.66:45927)
0805 22:57:16.473974 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.473981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.474001 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:57:16.474234 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.474238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.474320 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.474495 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:57:16.474878 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.475603 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.477245 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.477664 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.477801 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.478337 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:57:16.478879 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:57:16.479059 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.479114 (+ 55us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.479199 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 22:57:16.488355 10156 raft_consensus.cc:1261] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 FOLLOWER]: Refusing update from remote peer df090b9997d74b82a1e0b3f8c450b5a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:57:16.488353 9765 raft_consensus.cc:1261] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 1 FOLLOWER]: Refusing update from remote peer df090b9997d74b82a1e0b3f8c450b5a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:57:16.489339 10260 consensus_queue.cc:1035] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5180efcb3f5d4168bb8e6b5e4d827cec" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:57:16.489686 10256 consensus_queue.cc:1035] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60839f62b23f47ee84c632fda6801603" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:57:16.525803 9572 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:51186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:57:16.526085 9572 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:51186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:57:16.530058 9572 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Sending DeleteTablet for 3 replicas of tablet c1e496100e2044c597b825cbaada3a78
I20260805 22:57:16.531524 9740 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e496100e2044c597b825cbaada3a78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:16 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:43218
I20260805 22:57:16.531628 9924 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e496100e2044c597b825cbaada3a78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:16 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:44652
I20260805 22:57:16.531919 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 9625
I20260805 22:57:16.532015 10131 tablet_service.cc:1514] Processing DeleteTablet for tablet c1e496100e2044c597b825cbaada3a78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:16 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:46240
I20260805 22:57:16.533221 10281 tablet_replica.cc:330] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: stopping tablet replica
I20260805 22:57:16.533727 10281 raft_consensus.cc:2229] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:57:16.534340 10281 raft_consensus.cc:2258] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:16.534581 10279 tablet_replica.cc:330] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: stopping tablet replica
I20260805 22:57:16.534718 10280 tablet_replica.cc:330] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: stopping tablet replica
I20260805 22:57:16.535152 10280 raft_consensus.cc:2229] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:57:16.535912 10280 raft_consensus.cc:2258] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:16.536486 10279 raft_consensus.cc:2229] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:57:16.537061 10279 raft_consensus.cc:2258] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:16.539444 10279 ts_tablet_manager.cc:1905] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:16.539702 10281 ts_tablet_manager.cc:1905] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:16.541261 10280 ts_tablet_manager.cc:1905] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:16.548321 10281 ts_tablet_manager.cc:1918] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:16.548585 10281 log.cc:1196] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/c1e496100e2044c597b825cbaada3a78
I20260805 22:57:16.549266 10281 ts_tablet_manager.cc:1939] T c1e496100e2044c597b825cbaada3a78 P 5180efcb3f5d4168bb8e6b5e4d827cec: Deleting consensus metadata
I20260805 22:57:16.551522 9553 catalog_manager.cc:4841] TS 5180efcb3f5d4168bb8e6b5e4d827cec (127.20.34.67:35041): tablet c1e496100e2044c597b825cbaada3a78 (table test-table [id=9e3456bbfd1b42dbb0ca0045a92d8c94]) successfully deleted
I20260805 22:57:16.552498 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.532989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43220 (local address 127.20.34.65:34891)
0805 22:57:16.533169 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.533176 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.533631 (+ 455us) server_negotiation.cc:407] Connection header received
0805 22:57:16.533719 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.533726 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.533851 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.533959 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:16.535851 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.537145 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.538974 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.539639 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.539782 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.543288 (+ 3506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:16.543303 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:16.543324 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:16.543369 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:16.547820 (+ 4451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.549025 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.549036 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.549039 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.549220 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.549761 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.549766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.549769 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.550254 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:16.550577 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.551834 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.552079 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:57:16.556915 9821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:16.557579 10280 ts_tablet_manager.cc:1918] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:16.558632 10280 log.cc:1196] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/c1e496100e2044c597b825cbaada3a78
I20260805 22:57:16.559408 10280 ts_tablet_manager.cc:1939] T c1e496100e2044c597b825cbaada3a78 P df090b9997d74b82a1e0b3f8c450b5a7: Deleting consensus metadata
I20260805 22:57:16.561633 9553 catalog_manager.cc:4841] TS df090b9997d74b82a1e0b3f8c450b5a7 (127.20.34.66:45927): tablet c1e496100e2044c597b825cbaada3a78 (table test-table [id=9e3456bbfd1b42dbb0ca0045a92d8c94]) successfully deleted
I20260805 22:57:16.683676 10279 ts_tablet_manager.cc:1918] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:16.683965 10279 log.cc:1196] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/c1e496100e2044c597b825cbaada3a78
I20260805 22:57:16.684417 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 9625
W20260805 22:57:16.710748 9555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.34.65:34891 (error 108)
I20260805 22:57:16.711355 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 9833
I20260805 22:57:16.713061 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.712109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43234)
0805 22:57:16.712759 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.712871 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521}
W20260805 22:57:16.713344 9555 catalog_manager.cc:4584] TS 60839f62b23f47ee84c632fda6801603 (127.20.34.65:34891): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c1e496100e2044c597b825cbaada3a78: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
I20260805 22:57:16.729051 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.712329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44666 (local address 127.20.34.66:45927)
0805 22:57:16.712525 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.712532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.712553 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:57:16.712788 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.712795 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.712894 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.713003 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:16.714521 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.715833 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.717407 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.718101 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.718239 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.721179 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:16.721197 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:16.721220 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:16.721270 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:16.725580 (+ 4310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.726414 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.726425 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.726430 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.726624 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.727025 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.727033 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.727041 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.727595 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:16.727952 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.728343 (+ 391us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.728610 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:57:16.729839 10010 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:16.767048 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.766556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43248)
0805 22:57:16.766771 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.766880 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260805 22:57:16.768141 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.767788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43260)
0805 22:57:16.767939 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.768033 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260805 22:57:16.829252 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.828600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43266)
0805 22:57:16.828864 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.828984 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260805 22:57:16.830607 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.830120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43280)
0805 22:57:16.830313 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.830410 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260805 22:57:16.852319 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 9833
I20260805 22:57:16.884281 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 10024
I20260805 22:57:16.900606 10246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.885119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46248 (local address 127.20.34.67:35041)
0805 22:57:16.885338 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:16.885344 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:16.885366 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:57:16.885607 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:16.885612 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:16.885694 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:16.885808 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:16.887572 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.888529 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.889982 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:16.890405 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:16.890557 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:16.893945 (+ 3388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:16.893965 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:16.893984 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:16.894031 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:16.897147 (+ 3116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.898091 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.898100 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.898102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.898268 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:16.898774 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:16.898786 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:16.898788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:16.899186 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:16.899547 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:16.899916 (+ 369us) server_negotiation.cc:299] Negotiation successful
0805 22:57:16.900213 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 22:57:16.901327 10217 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:16.911988 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.911391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43296)
0805 22:57:16.911666 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.911767 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260805 22:57:16.913296 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:16.912879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43306)
0805 22:57:16.913102 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:16.913175 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260805 22:57:16.994199 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 10024
I20260805 22:57:17.020437 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 9529
I20260805 22:57:17.021874 9612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:17.141252 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:17.140488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34891 (local address 127.0.0.1:43320)
0805 22:57:17.140913 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:17.141043 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:34891: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260805 22:57:17.141434 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 9529
I20260805 22:57:17.172748 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34873
--webserver_interface=127.20.34.126
--webserver_port=40763
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:34873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:17.540408 10287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:17.540791 10287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:17.540967 10287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:17.548547 10287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:17.548707 10287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:17.548831 10287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:17.548938 10287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:17.549016 10287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:17.559439 10287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:34873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=40763
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:17.561043 10287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:17.562409 10287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:17.574954 10306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:17.575023 10300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:17.574999 10301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:17.575892 10287 server_base.cc:1034] running on GCE node
I20260805 22:57:17.576817 10287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:17.578456 10287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:17.579717 10287 hybrid_clock.cc:648] HybridClock initialized: now 1785970637579662 us; error 68 us; skew 500 ppm
I20260805 22:57:17.580129 10287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:17 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970637, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:17.583448 10287 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:57:17.585150 10287 webserver.cc:460] Webserver started at http://127.20.34.126:40763/ using document root <none> and password file <none>
I20260805 22:57:17.586025 10287 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:17.586179 10287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:17.591976 10287 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:57:17.595175 10314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:17.596727 10287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:57:17.596946 10287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "b8a26049955642a2bf9af7ab034c06a9"
format_stamp: "Formatted at 2026-08-05 22:57:10 on dist-test-slave-gmjp"
server_key: "1cff11c5d13acc245e41dbb83057fff0"
server_key_iv: "4ede06ca4b566698cb5b3996e8ab454e"
server_key_version: "encryptionkey@0"
I20260805 22:57:17.598011 10287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:17.617200 10287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:17.621440 10287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:17.621745 10287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:17.641667 10287 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:34873
I20260805 22:57:17.641674 10401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:34873 every 8 connection(s)
I20260805 22:57:17.643260 10287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:57:17.647306 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 10287
I20260805 22:57:17.648231 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:34891
--local_ip_for_outbound_sockets=127.20.34.65
--tserver_master_addrs=127.20.34.126:34873
--webserver_port=36315
--webserver_interface=127.20.34.65
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:57:17.650437 10402 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:57:17.653823 10402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Bootstrap starting.
I20260805 22:57:17.675521 10402 log.cc:824] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:17.692605 10402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:57:17.693178 10402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9: Bootstrap complete.
I20260805 22:57:17.703095 10402 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:17.704105 10402 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8a26049955642a2bf9af7ab034c06a9, State: Initialized, Role: FOLLOWER
I20260805 22:57:17.704852 10402 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:17.705113 10402 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:57:17.705251 10402 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:57:17.705449 10402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 2 FOLLOWER]: Advancing to term 3
I20260805 22:57:17.709503 10402 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:17.710055 10402 leader_election.cc:302] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8a26049955642a2bf9af7ab034c06a9; no voters:
I20260805 22:57:17.710770 10402 leader_election.cc:288] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260805 22:57:17.710919 10407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 22:57:17.712370 10407 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [term 3 LEADER]: Becoming Leader. State: Replica: b8a26049955642a2bf9af7ab034c06a9, State: Running, Role: LEADER
I20260805 22:57:17.713061 10407 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } }
I20260805 22:57:17.713413 10402 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:57:17.715762 10409 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a26049955642a2bf9af7ab034c06a9. Latest consensus state: current_term: 3 leader_uuid: "b8a26049955642a2bf9af7ab034c06a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } } }
I20260805 22:57:17.715893 10408 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b8a26049955642a2bf9af7ab034c06a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a26049955642a2bf9af7ab034c06a9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34873 } } }
I20260805 22:57:17.716322 10408 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:17.716370 10409 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a26049955642a2bf9af7ab034c06a9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:17.728672 10415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:57:17.738291 10415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:57:17.739938 10415 catalog_manager.cc:1259] Loaded cluster ID: 690b2fad85254217b670410c67c00a9c
I20260805 22:57:17.740130 10415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260805 22:57:17.743459 10415 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc10779d9ad google::LogMessage::Fail() at ??:0
@ 0x7fc1077a088a google::LogMessage::SendToLog() at ??:0
@ 0x7fc10779d4de google::LogMessage::Flush() at ??:0
@ 0x7fc10779ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc11d1d0512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fc11d1cd976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
I20260805 22:57:17.784744 10431 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7fc11d255610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fc11d255439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc10a3e9345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc10a3ec91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fc10a3ec799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc10a3c7eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc10d6a16db start_thread at ??:0
@ 0x7fc10663761f clone at ??:0
W20260805 22:57:18.093916 10404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:18.094362 10404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:18.094539 10404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:18.106083 10404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:18.106226 10404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:18.106442 10404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:57:18.119355 10404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:34891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=36315
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:18.121110 10404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:18.122836 10404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:18.137858 10458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:18.137805 10462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:18.137737 10459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:18.138644 10404 server_base.cc:1034] running on GCE node
I20260805 22:57:18.139478 10404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:18.140858 10404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:18.142109 10404 hybrid_clock.cc:648] HybridClock initialized: now 1785970638142033 us; error 61 us; skew 500 ppm
I20260805 22:57:18.142510 10404 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:18 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970638, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:18.146064 10404 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:57:18.147768 10404 webserver.cc:460] Webserver started at http://127.20.34.65:36315/ using document root <none> and password file <none>
I20260805 22:57:18.148599 10404 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:18.148767 10404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:18.154498 10404 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260805 22:57:18.157500 10471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:18.158985 10404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:57:18.159195 10404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "60839f62b23f47ee84c632fda6801603"
format_stamp: "Formatted at 2026-08-05 22:57:11 on dist-test-slave-gmjp"
server_key: "47947ef04bc1f9b87bf6ae2085016849"
server_key_iv: "3d396b5cd7fb848bf4ce177c60d91163"
server_key_version: "encryptionkey@0"
I20260805 22:57:18.160343 10404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:18.187338 10404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:18.191766 10404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:18.192063 10404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:18.193238 10404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:18.195425 10481 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260805 22:57:18.201258 10481 ts_tablet_manager.cc:1852] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260805 22:57:18.202270 10481 ts_tablet_manager.cc:1905] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:18.210959 10481 ts_tablet_manager.cc:1918] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:18.211340 10481 ts_tablet_manager.cc:1939] T c1e496100e2044c597b825cbaada3a78 P 60839f62b23f47ee84c632fda6801603: Deleting consensus metadata
I20260805 22:57:18.211885 10404 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260805 22:57:18.212078 10404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260805 22:57:18.212298 10404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:18.212400 10404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:18.249267 10404 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34891
I20260805 22:57:18.249321 10634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34891 every 8 connection(s)
I20260805 22:57:18.250689 10404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:57:18.256103 10638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:18.253958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:39643)
0805 22:57:18.254744 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:18.254986 (+ 242us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":324,"threads_started":1}
I20260805 22:57:18.256292 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 10404
W20260805 22:57:18.256912 10635 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:34873 (0 consecutive failures): Network error: Failed to ping master at 127.20.34.126:34873: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
I20260805 22:57:18.257190 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:45927
--local_ip_for_outbound_sockets=127.20.34.66
--tserver_master_addrs=127.20.34.126:34873
--webserver_port=33235
--webserver_interface=127.20.34.66
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:57:18.257994 10638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:18.257549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:60289)
0805 22:57:18.257743 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:18.257842 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260805 22:57:18.259039 10638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:18.258562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:42281)
0805 22:57:18.258752 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:18.258858 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260805 22:57:18.259290 10635 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:57:18.633585 10639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:18.634004 10639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:18.634207 10639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:18.642030 10639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:18.642236 10639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:18.642458 10639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:57:18.653167 10639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:45927
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=33235
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:18.654668 10639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:18.656139 10639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:18.670905 10649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:18.670939 10650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:18.670975 10654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:18.671777 10639 server_base.cc:1034] running on GCE node
I20260805 22:57:18.672696 10639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:18.673775 10639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:18.675009 10639 hybrid_clock.cc:648] HybridClock initialized: now 1785970638674959 us; error 62 us; skew 500 ppm
I20260805 22:57:18.675371 10639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:18 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970638, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:18.682668 10639 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:57:18.684461 10639 webserver.cc:460] Webserver started at http://127.20.34.66:33235/ using document root <none> and password file <none>
I20260805 22:57:18.685226 10639 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:18.685400 10639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:18.691332 10639 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260805 22:57:18.694559 10662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:18.696087 10639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:57:18.696337 10639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "df090b9997d74b82a1e0b3f8c450b5a7"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "fdc9d3d3e1b42db2121d9739bd0779c0"
server_key_iv: "e239aa1cca70ef44e891da5ba53fbe48"
server_key_version: "encryptionkey@0"
I20260805 22:57:18.697479 10639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:18.718969 10639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:18.723470 10639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:18.723793 10639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:18.724982 10639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:18.726516 10639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:18.726657 10639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:18.726806 10639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:18.726910 10639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:18.763295 10639 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:45927
I20260805 22:57:18.763358 10824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:45927 every 8 connection(s)
I20260805 22:57:18.765201 10639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:57:18.770222 10827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:18.768368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:47397)
0805 22:57:18.769127 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:18.769335 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":278,"threads_started":1}
W20260805 22:57:18.770922 10825 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:34873 (0 consecutive failures): Network error: Failed to ping master at 127.20.34.126:34873: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
I20260805 22:57:18.771772 10827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:18.771458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:33799)
0805 22:57:18.771599 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:18.771669 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260805 22:57:18.772665 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 10639
I20260805 22:57:18.772854 10827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:18.772433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:49941)
0805 22:57:18.772602 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:18.772700 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260805 22:57:18.773126 10825 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:57:18.773524 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:35041
--local_ip_for_outbound_sockets=127.20.34.67
--tserver_master_addrs=127.20.34.126:34873
--webserver_port=34859
--webserver_interface=127.20.34.67
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:37903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:19.140463 10828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:19.140779 10828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:19.140878 10828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:19.149691 10828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:19.149827 10828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:19.149942 10828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:57:19.160302 10828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:37903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:35041
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=34859
--tserver_master_addrs=127.20.34.126:34873
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:19.161685 10828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:19.163080 10828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:19.178027 10833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:19.178011 10838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:19.178050 10835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:19.178887 10828 server_base.cc:1034] running on GCE node
I20260805 22:57:19.179656 10828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:19.180781 10828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:19.182047 10828 hybrid_clock.cc:648] HybridClock initialized: now 1785970639181981 us; error 45 us; skew 500 ppm
I20260805 22:57:19.182529 10828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:19 dist-test-slave-gmjp krb5kdc[8725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970639, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:19.187860 10828 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:57:19.190523 10828 webserver.cc:460] Webserver started at http://127.20.34.67:34859/ using document root <none> and password file <none>
I20260805 22:57:19.191548 10828 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:19.191694 10828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:19.197664 10828 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260805 22:57:19.200665 10849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:19.202284 10828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 22:57:19.202531 10828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "5180efcb3f5d4168bb8e6b5e4d827cec"
format_stamp: "Formatted at 2026-08-05 22:57:12 on dist-test-slave-gmjp"
server_key: "c4032e507bb654f3e6ed436a72b7b91c"
server_key_iv: "faa088676f1fb86b1b2d3b4d4286b5a8"
server_key_version: "encryptionkey@0"
I20260805 22:57:19.203667 10828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:19.221194 10828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:19.225360 10828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:19.225634 10828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:19.226673 10828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:19.228088 10828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:19.228204 10828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 22:57:19.228289 10828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:19.228359 10828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:19.261225 10998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:19.260037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:46781)
0805 22:57:19.260715 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:19.260846 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":329,"threads_started":1}
I20260805 22:57:19.264751 10828 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:35041
I20260805 22:57:19.264832 11010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:35041 every 8 connection(s)
I20260805 22:57:19.266481 10828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:57:19.268352 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 10828
I20260805 22:57:19.271613 11015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:19.269682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:36263)
0805 22:57:19.270536 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:19.270735 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":345,"threads_started":1}
W20260805 22:57:19.272397 11011 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:34873 (0 consecutive failures): Network error: Failed to ping master at 127.20.34.126:34873: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
I20260805 22:57:19.273207 11015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:19.272902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:42505)
0805 22:57:19.273037 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:19.273104 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260805 22:57:19.274029 11015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:19.273733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:50465)
0805 22:57:19.273853 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:19.273930 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 22:57:19.274272 11011 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:57:19.774562 11016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:19.773696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:50373)
0805 22:57:19.774203 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:19.774317 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":225,"threads_started":1}
I20260805 22:57:20.263123 11018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:20.262321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:57407)
0805 22:57:20.262851 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:20.262944 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":266,"threads_started":1}
I20260805 22:57:20.275755 11019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:20.274924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:44629)
0805 22:57:20.275416 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:20.275532 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":240,"threads_started":1}
I20260805 22:57:20.776594 11020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:20.775623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:39781)
0805 22:57:20.776271 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:20.776387 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":252,"threads_started":1}
I20260805 22:57:21.265331 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:21.264367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:52597)
0805 22:57:21.264976 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:21.265166 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":319,"threads_started":1}
I20260805 22:57:21.277774 11023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:21.276799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:48735)
0805 22:57:21.277506 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:21.277598 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":313,"threads_started":1}
I20260805 22:57:21.778467 11025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:21.777575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:40523)
0805 22:57:21.778132 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:21.778265 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":271,"threads_started":1}
I20260805 22:57:22.267163 11026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:22.266369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:59759)
0805 22:57:22.266876 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:22.266971 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":266,"threads_started":1}
I20260805 22:57:22.279666 11027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:22.278830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:55273)
0805 22:57:22.279393 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:22.279485 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":321,"threads_started":1}
I20260805 22:57:22.780516 11029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:22.779557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:60871)
0805 22:57:22.780226 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:22.780320 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":282,"threads_started":1}
I20260805 22:57:23.269107 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:23.268264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:58123)
0805 22:57:23.268843 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:23.268940 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":287,"threads_started":1}
I20260805 22:57:23.281688 11031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:23.280911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:43757)
0805 22:57:23.281422 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:23.281511 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":239,"threads_started":1}
I20260805 22:57:23.782545 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:23.781606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:46097)
0805 22:57:23.782251 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:23.782358 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":345,"threads_started":1}
I20260805 22:57:24.271196 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:24.270233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:60877)
0805 22:57:24.270865 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:24.271005 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":316,"threads_started":1}
I20260805 22:57:24.283759 11034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:24.282920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:36889)
0805 22:57:24.283485 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:24.283577 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":281,"threads_started":1}
I20260805 22:57:24.784549 11036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:24.783563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:51527)
0805 22:57:24.784108 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:24.784271 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":248,"threads_started":1}
I20260805 22:57:25.273190 11037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:25.272345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:52703)
0805 22:57:25.272880 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:25.272985 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":228,"threads_started":1}
I20260805 22:57:25.285689 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:25.284790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:37173)
0805 22:57:25.285397 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:25.285519 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":343,"threads_started":1}
I20260805 22:57:25.787079 11042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:25.785840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:51847)
0805 22:57:25.786723 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:25.786826 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":377,"threads_started":1}
I20260805 22:57:26.275014 11043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:26.274218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:48327)
0805 22:57:26.274714 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:26.274814 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":263,"threads_started":1}
I20260805 22:57:26.287585 11045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:26.286689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:59021)
0805 22:57:26.287215 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:26.287301 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":218,"threads_started":1}
I20260805 22:57:26.789113 11046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:26.788267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:58935)
0805 22:57:26.788829 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:26.788933 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":317,"threads_started":1}
I20260805 22:57:27.276885 11047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:27.275963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:51009)
0805 22:57:27.276614 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:27.276713 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":362,"threads_started":1}
I20260805 22:57:27.289464 11048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:27.288666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:35001)
0805 22:57:27.289158 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:27.289253 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":253,"threads_started":1}
I20260805 22:57:27.790869 11049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:27.790087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:38015)
0805 22:57:27.790599 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:27.790687 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":240,"threads_started":1}
I20260805 22:57:28.278671 11050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:28.277912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:49337)
0805 22:57:28.278373 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:28.278476 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":248,"threads_started":1}
I20260805 22:57:28.291225 11053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:28.290492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:43975)
0805 22:57:28.290971 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:28.291051 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":223,"threads_started":1}
I20260805 22:57:28.792613 11054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:28.791836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:33959)
0805 22:57:28.792341 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:28.792445 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":233,"threads_started":1}
I20260805 22:57:29.280465 11055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:29.279628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:59323)
0805 22:57:29.280108 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:29.280263 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":272,"threads_started":1}
I20260805 22:57:29.293720 11056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:29.292661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:43381)
0805 22:57:29.293312 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:29.293468 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":339,"threads_started":1}
I20260805 22:57:29.794608 11059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:29.793600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:37439)
0805 22:57:29.794302 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:29.794407 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":437,"threads_started":1}
I20260805 22:57:30.282078 11060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:30.281367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:35985)
0805 22:57:30.281803 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:30.281885 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":234,"threads_started":1}
I20260805 22:57:30.295605 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:30.294736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:40699)
0805 22:57:30.295304 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:30.295411 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":303,"threads_started":1}
I20260805 22:57:30.796598 11064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:30.795751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:42771)
0805 22:57:30.796328 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:30.796429 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":293,"threads_started":1}
I20260805 22:57:31.283722 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:31.282986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:48391)
0805 22:57:31.283441 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:31.283546 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":228,"threads_started":1}
I20260805 22:57:31.297487 11067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:31.296641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:56307)
0805 22:57:31.297229 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:31.297318 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":337,"threads_started":1}
I20260805 22:57:31.798401 11068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:31.797526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:52401)
0805 22:57:31.798094 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:31.798198 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":272,"threads_started":1}
I20260805 22:57:32.285676 11069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:32.284819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:51443)
0805 22:57:32.285361 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:32.285459 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":279,"threads_started":1}
I20260805 22:57:32.299381 11071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:32.298451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:52895)
0805 22:57:32.299076 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:32.299173 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":344,"threads_started":1}
I20260805 22:57:32.800395 11072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:32.799512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:43927)
0805 22:57:32.800027 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:32.800130 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":275,"threads_started":1}
I20260805 22:57:33.287889 11074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:33.287036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:47059)
0805 22:57:33.287609 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:33.287724 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":280,"threads_started":1}
I20260805 22:57:33.301263 11076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:33.300430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:49195)
0805 22:57:33.300928 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:33.301018 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":238,"threads_started":1}
I20260805 22:57:33.802495 11080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:33.801739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.66:47573)
0805 22:57:33.802194 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:33.802294 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":219,"threads_started":1}
I20260805 22:57:34.270744 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 10404
I20260805 22:57:34.290123 11083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:34.288937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.65:60645)
0805 22:57:34.289577 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:34.289832 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":279,"threads_started":1}
I20260805 22:57:34.295324 11082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:34.272066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46722 (local address 127.20.34.65:34891)
0805 22:57:34.272890 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:34.272904 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:34.272944 (+ 40us) server_negotiation.cc:407] Connection header received
0805 22:57:34.274669 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:34.274681 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:34.275150 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:34.275467 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:34.277031 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:34.278478 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:34.279883 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:34.280723 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:34.280895 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:34.288501 (+ 7606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:34.288511 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:34.288531 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:34.288613 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:34.292067 (+ 3454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:34.292966 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:34.292973 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:34.292981 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:34.293147 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:34.293544 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:34.293547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:34.293549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:34.294097 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:34.294333 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:34.294702 (+ 369us) server_negotiation.cc:299] Negotiation successful
0805 22:57:34.295035 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":502,"threads_started":1}
I20260805 22:57:34.296841 10629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:34.303488 11085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:34.302557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34873 (local address 127.20.34.67:44565)
0805 22:57:34.303115 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:34.303246 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:34873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":273,"threads_started":1}
I20260805 22:57:34.385831 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 10404
I20260805 22:57:34.414858 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 10639
I20260805 22:57:34.434314 11088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:34.415824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59548 (local address 127.20.34.66:45927)
0805 22:57:34.416447 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:34.416461 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:34.416502 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:57:34.418167 (+ 1665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:34.418177 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:34.418643 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:34.419028 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:34.420848 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:34.422096 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:34.423470 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:34.424249 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:34.424464 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:34.427604 (+ 3140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:34.427613 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:34.427631 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:34.427674 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:34.430663 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:34.431418 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:34.431426 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:34.431433 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:34.431619 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:34.432031 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:34.432037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:34.432040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:34.432686 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:34.433033 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:34.433531 (+ 498us) server_negotiation.cc:299] Negotiation successful
0805 22:57:34.434006 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":265,"threads_started":1}
I20260805 22:57:34.435791 10820 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:34.522238 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 10639
I20260805 22:57:34.549314 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 10828
I20260805 22:57:34.567893 11092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:34.550259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.20.34.67:35041)
0805 22:57:34.550921 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:34.550937 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:34.550982 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:57:34.552773 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:34.552784 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:34.553235 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:34.553553 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:34.554919 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:34.556237 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:34.557636 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:34.558322 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:34.558491 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:34.561368 (+ 2877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:34.561377 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:34.561406 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:34.561456 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:34.564738 (+ 3282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:34.565456 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:34.565463 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:34.565471 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:34.565640 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:34.565989 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:34.565993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:34.565995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:34.566597 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:34.566830 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:34.567201 (+ 371us) server_negotiation.cc:299] Negotiation successful
0805 22:57:34.567573 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":312,"threads_started":1}
I20260805 22:57:34.569430 11005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:34.655349 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 10828
2026-08-05T22:57:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25745 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:57:34 dist-test-slave-gmjp krb5kdc[11097](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:57:34 dist-test-slave-gmjp krb5kdc[11097](info): set up 2 sockets
Aug 05 22:57:34 dist-test-slave-gmjp krb5kdc[11097](info): commencing operation
krb5kdc: starting...
W20260805 22:57:35.986665 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:57:36 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:57:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:57:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:57:36.329916 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39757
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:39757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:36.686108 11122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:36.686497 11122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:36.686694 11122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:36.694265 11122 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:57:36.694408 11122 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:57:36.694504 11122 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:57:36.694600 11122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:36.694742 11122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:36.694892 11122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:36.694985 11122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:36.695075 11122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:36.705415 11122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:39757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:36.706871 11122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:36.708277 11122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:36.721058 11128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:36.721004 11132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:36.721077 11129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:36.721930 11122 server_base.cc:1034] running on GCE node
I20260805 22:57:36.722841 11122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:36.724404 11122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:36.725631 11122 hybrid_clock.cc:648] HybridClock initialized: now 1785970656725551 us; error 54 us; skew 500 ppm
I20260805 22:57:36.726015 11122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:36 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970656, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:36.729466 11122 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:57:36.731240 11122 webserver.cc:460] Webserver started at http://127.20.34.126:32967/ using document root <none> and password file <none>
I20260805 22:57:36.732014 11122 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:36.732133 11122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:36.732524 11122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:36.735603 11122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "46596313e78f41069cec9cc2e0cbe343"
format_stamp: "Formatted at 2026-08-05 22:57:36 on dist-test-slave-gmjp"
server_key: "14d46b02d097257d460f322cbf294bd1"
server_key_iv: "8df923c3140601c21b50e08fe4720928"
server_key_version: "encryptionkey@0"
I20260805 22:57:36.736482 11122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "46596313e78f41069cec9cc2e0cbe343"
format_stamp: "Formatted at 2026-08-05 22:57:36 on dist-test-slave-gmjp"
server_key: "14d46b02d097257d460f322cbf294bd1"
server_key_iv: "8df923c3140601c21b50e08fe4720928"
server_key_version: "encryptionkey@0"
I20260805 22:57:36.742290 11122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:57:36.745973 11142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:36.747452 11122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:57:36.747651 11122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "46596313e78f41069cec9cc2e0cbe343"
format_stamp: "Formatted at 2026-08-05 22:57:36 on dist-test-slave-gmjp"
server_key: "14d46b02d097257d460f322cbf294bd1"
server_key_iv: "8df923c3140601c21b50e08fe4720928"
server_key_version: "encryptionkey@0"
I20260805 22:57:36.747896 11122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:36.765462 11122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:36.770463 11122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:36.770787 11122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:36.789415 11122 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:39757
I20260805 22:57:36.789444 11214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:39757 every 8 connection(s)
I20260805 22:57:36.790930 11122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:57:36.794165 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 11122
I20260805 22:57:36.794430 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:57:36.795059 11215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:36.795224 20617 external_mini_cluster.cc:1428] Setting key 3efe4128fabd0f576c251806950361fb
I20260805 22:57:36.810375 11215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Bootstrap starting.
Aug 05 22:57:36 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:36.814262 11215 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:36.815625 11215 log.cc:824] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:36.818866 11215 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: No bootstrap required, opened a new log
I20260805 22:57:36.821626 11220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:36.797482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60084 (local address 127.20.34.126:39757)
0805 22:57:36.798505 (+ 1023us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:36.798522 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:36.798567 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:57:36.800399 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:36.800428 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:36.800929 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:36.801343 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:36.803365 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:36.804765 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:36.807020 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:36.807821 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:36.807977 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:36.813202 (+ 5225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:36.813212 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:36.813235 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:36.813281 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:36.817013 (+ 3732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:36.817912 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:36.817920 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:36.817927 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:36.818110 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:36.818567 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:36.818573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:36.818578 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:36.819223 (+ 645us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:36.819564 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:36.820037 (+ 473us) server_negotiation.cc:299] Negotiation successful
0805 22:57:36.820551 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":779,"thread_start_us":454,"threads_started":1}
I20260805 22:57:36.827684 11215 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:57:36.828085 11215 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:36.828218 11215 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46596313e78f41069cec9cc2e0cbe343, State: Initialized, Role: FOLLOWER
I20260805 22:57:36.828935 11215 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:57:36.829221 11215 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:57:36.829404 11215 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:57:36.829596 11215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:36.831873 11215 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:57:36.832504 11215 leader_election.cc:302] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46596313e78f41069cec9cc2e0cbe343; no voters:
I20260805 22:57:36.833101 11215 leader_election.cc:288] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:57:36.833285 11222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:57:36.834029 11222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 1 LEADER]: Becoming Leader. State: Replica: 46596313e78f41069cec9cc2e0cbe343, State: Running, Role: LEADER
I20260805 22:57:36.834555 11222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:57:36.835302 11215 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:57:36.837502 11224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46596313e78f41069cec9cc2e0cbe343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } } }
I20260805 22:57:36.837949 11224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:36.837845 11226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46596313e78f41069cec9cc2e0cbe343. Latest consensus state: current_term: 1 leader_uuid: "46596313e78f41069cec9cc2e0cbe343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } } }
I20260805 22:57:36.838128 11226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: This master's current role is: LEADER
I20260805 22:57:36.840416 11235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:57:36.846062 11235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:57:36.855091 11235 catalog_manager.cc:1347] Generated new cluster ID: 023f839c2c9f4e9f88d8a3eecb4adf0b
I20260805 22:57:36.855218 11235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:57:36.890444 11235 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:57:36.891920 11235 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:57:36.901656 11235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Generated new TSK 0
I20260805 22:57:36.902684 11235 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:57:36.988624 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39757
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:37.362165 11255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:37.362499 11255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:37.362601 11255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:37.370184 11255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:37.370316 11255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:37.370433 11255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:57:37.380811 11255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:37.382201 11255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:37.383586 11255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:37.398034 11262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:37.398126 11265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:37.398126 11263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:37.399209 11255 server_base.cc:1034] running on GCE node
I20260805 22:57:37.399960 11255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:37.401224 11255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:37.402462 11255 hybrid_clock.cc:648] HybridClock initialized: now 1785970657402416 us; error 43 us; skew 500 ppm
I20260805 22:57:37.402830 11255 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:37 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970657, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:37.406286 11255 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:57:37.407838 11255 webserver.cc:460] Webserver started at http://127.20.34.65:34083/ using document root <none> and password file <none>
I20260805 22:57:37.408633 11255 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:37.408797 11255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:37.409137 11255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:37.412426 11255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "81b9cf0f757b439089e583aed8a54918"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "f952fc1c854c285bd5c313cd366c2800"
server_key_iv: "5d3f22c93292bd1a0abc14a81575ac68"
server_key_version: "encryptionkey@0"
I20260805 22:57:37.413235 11255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "81b9cf0f757b439089e583aed8a54918"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "f952fc1c854c285bd5c313cd366c2800"
server_key_iv: "5d3f22c93292bd1a0abc14a81575ac68"
server_key_version: "encryptionkey@0"
I20260805 22:57:37.418658 11255 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:57:37.422530 11275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:37.423909 11255 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:57:37.424098 11255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "81b9cf0f757b439089e583aed8a54918"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "f952fc1c854c285bd5c313cd366c2800"
server_key_iv: "5d3f22c93292bd1a0abc14a81575ac68"
server_key_version: "encryptionkey@0"
I20260805 22:57:37.424368 11255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:37.454075 11255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:37.458678 11255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:37.459002 11255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:37.460071 11255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:37.461539 11255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:37.461613 11255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:37.461773 11255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:37.461843 11255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:37.496672 11255 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:40161
I20260805 22:57:37.496719 11421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:40161 every 8 connection(s)
I20260805 22:57:37.498162 11255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:57:37.503587 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 11255
I20260805 22:57:37.503834 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:57:37.504637 20617 external_mini_cluster.cc:1428] Setting key d378d636af660271ffe939e71c46022a
Aug 05 22:57:37 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970657, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:37.520043 11425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:37.501402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:40201 (local address 127.20.34.126:39757)
0805 22:57:37.501911 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:37.501916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:37.502809 (+ 893us) server_negotiation.cc:407] Connection header received
0805 22:57:37.504965 (+ 2156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:37.504971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:37.505073 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:37.505197 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:37.506785 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:37.507529 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:37.509200 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:37.509623 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:37.509766 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:37.513685 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:37.513690 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:37.513693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:37.513729 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:37.516627 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:37.517484 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:37.517489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:37.517491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:37.517619 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:37.518121 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:37.518125 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:37.518127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:37.518418 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:37.518593 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:37.519370 (+ 777us) server_negotiation.cc:299] Negotiation successful
0805 22:57:37.519628 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":270,"threads_started":1}
I20260805 22:57:37.521166 11426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:37.501925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:40201)
0805 22:57:37.502638 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:37.502684 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:37.504635 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:37.505473 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:37.505482 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:37.506010 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:37.506609 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:37.506627 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:37.507710 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:37.507714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:37.509050 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:37.509062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:37.509878 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:37.509886 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:37.510128 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:37.510851 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:37.510875 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:37.513431 (+ 2556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:37.516808 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:37.516819 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:37.516842 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:37.517330 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:37.517744 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:37.517749 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:37.517753 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:37.517985 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:37.518568 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:37.518578 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:37.518977 (+ 399us) client_negotiation.cc:769] Sending connection context
0805 22:57:37.519249 (+ 272us) client_negotiation.cc:240] Negotiation successful
0805 22:57:37.519838 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":288,"threads_started":1}
I20260805 22:57:37.522902 11422 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39757
I20260805 22:57:37.523228 11422 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:37.523999 11422 heartbeater.cc:511] Master 127.20.34.126:39757 requested a full tablet report, sending...
I20260805 22:57:37.526324 11167 ts_manager.cc:194] Registered new tserver with Master: 81b9cf0f757b439089e583aed8a54918 (127.20.34.65:40161)
I20260805 22:57:37.527882 11167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:40201
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:57:37.579648 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39757
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:37.943049 11431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:37.943415 11431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:37.943602 11431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:37.951073 11431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:37.951227 11431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:37.951445 11431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:57:37.961585 11431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:37.963128 11431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:37.964604 11431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:37.978653 11438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:37.978754 11441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:37.978708 11437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:37.979900 11431 server_base.cc:1034] running on GCE node
I20260805 22:57:37.980638 11431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:37.981632 11431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:37.982848 11431 hybrid_clock.cc:648] HybridClock initialized: now 1785970657982804 us; error 38 us; skew 500 ppm
I20260805 22:57:37.983147 11431 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:37 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970657, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:37.986493 11431 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:57:37.988204 11431 webserver.cc:460] Webserver started at http://127.20.34.66:33407/ using document root <none> and password file <none>
I20260805 22:57:37.988996 11431 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:37.989151 11431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:37.989506 11431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:37.992684 11431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "16e7ea2340bf4585b5c74ac295f18441"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "2d996fc7e9b89e2b50e4143cbb15ba14"
server_key_iv: "9faacfac6a837cd9133efad25904255f"
server_key_version: "encryptionkey@0"
I20260805 22:57:37.993534 11431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "16e7ea2340bf4585b5c74ac295f18441"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "2d996fc7e9b89e2b50e4143cbb15ba14"
server_key_iv: "9faacfac6a837cd9133efad25904255f"
server_key_version: "encryptionkey@0"
I20260805 22:57:37.998983 11431 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260805 22:57:38.002635 11453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:38.004019 11431 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:57:38.004225 11431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "16e7ea2340bf4585b5c74ac295f18441"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "2d996fc7e9b89e2b50e4143cbb15ba14"
server_key_iv: "9faacfac6a837cd9133efad25904255f"
server_key_version: "encryptionkey@0"
I20260805 22:57:38.004431 11431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:38.033658 11431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:38.038256 11431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:38.038542 11431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:38.039532 11431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:38.041035 11431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:38.041111 11431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:38.041201 11431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:38.041246 11431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:38.077893 11431 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:44971
I20260805 22:57:38.077943 11609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:44971 every 8 connection(s)
I20260805 22:57:38.079383 11431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:57:38.084666 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 11431
I20260805 22:57:38.084888 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:57:38.085363 20617 external_mini_cluster.cc:1428] Setting key 07b345edc392b4017ace3e16913f903e
Aug 05 22:57:38 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970657, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:38.103969 11613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.082250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:49435 (local address 127.20.34.126:39757)
0805 22:57:38.082867 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.082875 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.083910 (+ 1035us) server_negotiation.cc:407] Connection header received
0805 22:57:38.086127 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.086132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.086250 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.086383 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:38.088500 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.089717 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.091354 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.092100 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.092285 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.095965 (+ 3680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:38.095974 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:38.095982 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:38.096034 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:38.099982 (+ 3948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:38.100925 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:38.100934 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:38.100940 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:38.101121 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:38.101592 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:38.101600 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:38.101605 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:38.102030 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:38.102207 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.103205 (+ 998us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.103493 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":333,"threads_started":1}
I20260805 22:57:38.104831 11614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.082975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:49435)
0805 22:57:38.083714 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:38.083764 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:38.085769 (+ 2005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:38.086693 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:38.086705 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:38.087559 (+ 854us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:38.088312 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.088333 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.089888 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.089891 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.091189 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.091202 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.092355 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.092360 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.092574 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.093313 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:38.093338 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:38.095655 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:38.100239 (+ 4584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:38.100248 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:38.100265 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:38.100781 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:38.101247 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:38.101250 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:38.101252 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:38.101465 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:38.102182 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:38.102192 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:38.102683 (+ 491us) client_negotiation.cc:769] Sending connection context
0805 22:57:38.103030 (+ 347us) client_negotiation.cc:240] Negotiation successful
0805 22:57:38.103480 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":282,"threads_started":1}
I20260805 22:57:38.106519 11610 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39757
I20260805 22:57:38.106874 11610 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:38.107764 11610 heartbeater.cc:511] Master 127.20.34.126:39757 requested a full tablet report, sending...
I20260805 22:57:38.109506 11167 ts_manager.cc:194] Registered new tserver with Master: 16e7ea2340bf4585b5c74ac295f18441 (127.20.34.66:44971)
I20260805 22:57:38.110374 11167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:49435
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:57:38.160297 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39757
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:57:38.532217 11422 heartbeater.cc:503] Master 127.20.34.126:39757 was elected leader, sending a full tablet report...
W20260805 22:57:38.540347 11618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:38.540709 11618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:38.540832 11618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:38.548401 11618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:38.548528 11618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:38.548657 11618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:57:38.559209 11618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:38.560670 11618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:38.562091 11618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:57:38.576107 11628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:38.575994 11627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:57:38.576053 11631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:57:38.577293 11618 server_base.cc:1034] running on GCE node
I20260805 22:57:38.577986 11618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:57:38.579033 11618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:57:38.580263 11618 hybrid_clock.cc:648] HybridClock initialized: now 1785970658580187 us; error 63 us; skew 500 ppm
I20260805 22:57:38.580618 11618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:57:38 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970658, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:57:38.583986 11618 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:57:38.585738 11618 webserver.cc:460] Webserver started at http://127.20.34.67:43025/ using document root <none> and password file <none>
I20260805 22:57:38.586491 11618 fs_manager.cc:359] Metadata directory not provided
I20260805 22:57:38.586648 11618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:57:38.586997 11618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:57:38.590382 11618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "60e5674814b54303977ced792259cbdf"
format_stamp: "Formatted at 2026-08-05 22:57:38 on dist-test-slave-gmjp"
server_key: "6deb5b363432d8c96dfdb8429e757ed0"
server_key_iv: "8f24c246ff76b279b07be2485c5a81f0"
server_key_version: "encryptionkey@0"
I20260805 22:57:38.591228 11618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "60e5674814b54303977ced792259cbdf"
format_stamp: "Formatted at 2026-08-05 22:57:38 on dist-test-slave-gmjp"
server_key: "6deb5b363432d8c96dfdb8429e757ed0"
server_key_iv: "8f24c246ff76b279b07be2485c5a81f0"
server_key_version: "encryptionkey@0"
I20260805 22:57:38.596987 11618 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:57:38.600732 11641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:38.602437 11618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260805 22:57:38.602608 11618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "60e5674814b54303977ced792259cbdf"
format_stamp: "Formatted at 2026-08-05 22:57:38 on dist-test-slave-gmjp"
server_key: "6deb5b363432d8c96dfdb8429e757ed0"
server_key_iv: "8f24c246ff76b279b07be2485c5a81f0"
server_key_version: "encryptionkey@0"
I20260805 22:57:38.602840 11618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:57:38.630690 11618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:57:38.635138 11618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:57:38.635458 11618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:57:38.636593 11618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:57:38.638028 11618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:57:38.638135 11618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:38.638289 11618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:57:38.638365 11618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:57:38.674042 11618 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:37101
I20260805 22:57:38.674093 11799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:37101 every 8 connection(s)
I20260805 22:57:38.675381 11618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:57:38.680675 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 11618
I20260805 22:57:38.680887 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:57:38.681346 20617 external_mini_cluster.cc:1428] Setting key 47c1711c1e18f2e347d79268b45f54fa
Aug 05 22:57:38 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970658, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:57:38.696367 11804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.678084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:51161 (local address 127.20.34.126:39757)
0805 22:57:38.678544 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.678549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.679563 (+ 1014us) server_negotiation.cc:407] Connection header received
0805 22:57:38.681697 (+ 2134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.681703 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.681802 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.681937 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:38.683529 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.684446 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.686037 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.686469 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.686611 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.690300 (+ 3689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:38.690305 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:38.690309 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:38.690343 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:38.693045 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:38.693835 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:38.693842 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:38.693846 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:38.694002 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:38.694461 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:38.694469 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:38.694474 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:38.694767 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:38.694944 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.695673 (+ 729us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.695921 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":205,"threads_started":1}
I20260805 22:57:38.697608 11805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.678677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:51161)
0805 22:57:38.679382 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:38.679437 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:38.681364 (+ 1927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:38.682182 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:38.682190 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:38.682742 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:57:38.683333 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.683353 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.684618 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.684622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.685867 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.685884 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.686709 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.686717 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.686955 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.687620 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:57:38.687644 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:57:38.690065 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:57:38.693201 (+ 3136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:38.693211 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:38.693231 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:38.693703 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:38.694123 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:57:38.694129 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:57:38.694132 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:57:38.694335 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:57:38.694908 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:57:38.694917 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:57:38.695290 (+ 373us) client_negotiation.cc:769] Sending connection context
0805 22:57:38.695587 (+ 297us) client_negotiation.cc:240] Negotiation successful
0805 22:57:38.696208 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":280,"threads_started":1}
I20260805 22:57:38.698994 11800 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39757
I20260805 22:57:38.699323 11800 heartbeater.cc:464] Registering TS with master...
I20260805 22:57:38.700058 11800 heartbeater.cc:511] Master 127.20.34.126:39757 requested a full tablet report, sending...
I20260805 22:57:38.701532 11167 ts_manager.cc:194] Registered new tserver with Master: 60e5674814b54303977ced792259cbdf (127.20.34.67:37101)
I20260805 22:57:38.702360 11167 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:51161
I20260805 22:57:38.709303 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:57:38.727193 11804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.714028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60086 (local address 127.20.34.126:39757)
0805 22:57:38.714264 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.714274 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.714708 (+ 434us) server_negotiation.cc:407] Connection header received
0805 22:57:38.714842 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.714846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.714932 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.715010 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:38.716631 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.717375 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.718916 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.719316 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.719412 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.721808 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:38.721813 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:38.721816 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:38.721850 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:38.724655 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:38.725308 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:38.725312 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:38.725314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:38.725435 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:38.725789 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:38.725792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:38.725794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:38.726128 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:38.726311 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.726617 (+ 306us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.726800 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:57:38.731622 11167 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:57:38.739034 11167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:57:38.774935 11821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.754121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59508)
0805 22:57:38.766094 (+ 11973us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:38.766118 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:38.766275 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:38.767132 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:38.767137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:38.767164 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:38.768067 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.768080 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.769871 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.769876 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.772082 (+ 2206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.772096 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.774050 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.774054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.774253 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.774317 (+ 64us) client_negotiation.cc:769] Sending connection context
0805 22:57:38.774446 (+ 129us) client_negotiation.cc:240] Negotiation successful
0805 22:57:38.774632 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11830,"mutex_wait_us":379,"thread_start_us":10648,"threads_started":1}
I20260805 22:57:38.775097 11827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.754559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59508 (local address 127.20.34.65:40161)
0805 22:57:38.766517 (+ 11958us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.766526 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.766549 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:57:38.766633 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.766639 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.766837 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.767501 (+ 664us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:38.768305 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.769693 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.772335 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.773840 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.774002 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.774260 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.774551 (+ 291us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.774730 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11771,"thread_start_us":11584,"threads_started":1}
I20260805 22:57:38.776221 11825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.752932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59458 (local address 127.20.34.66:44971)
0805 22:57:38.764559 (+ 11627us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.764574 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.766457 (+ 1883us) server_negotiation.cc:407] Connection header received
0805 22:57:38.766581 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.766588 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.766840 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.767038 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:38.768031 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.769900 (+ 1869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.772889 (+ 2989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.774396 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.774581 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.774770 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.775721 (+ 951us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.775889 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11367,"thread_start_us":11218,"threads_started":1}
I20260805 22:57:38.776273 11826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.752261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:44971 (local address 127.0.0.1:59458)
0805 22:57:38.765154 (+ 12893us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:38.765181 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:38.765378 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:38.767173 (+ 1795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:38.767177 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:38.767223 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:38.767812 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.767823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.770077 (+ 2254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.770084 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.772720 (+ 2636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.772735 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.775406 (+ 2671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.775413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.775544 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.775567 (+ 23us) client_negotiation.cc:769] Sending connection context
0805 22:57:38.775675 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 22:57:38.775800 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12707,"mutex_wait_us":174,"spinlock_wait_cycles":4352,"thread_start_us":849,"threads_started":1}
I20260805 22:57:38.778796 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.751617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:37101 (local address 127.0.0.1:41906)
0805 22:57:38.753215 (+ 1598us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:38.753266 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:38.753515 (+ 249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:38.766854 (+ 13339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:38.766861 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:38.766905 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:38.767558 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.767573 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.769773 (+ 2200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.769778 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.772720 (+ 2942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.772735 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.777927 (+ 5192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.777933 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.778115 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.778148 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 22:57:38.778255 (+ 107us) client_negotiation.cc:240] Negotiation successful
0805 22:57:38.778385 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1285,"mutex_wait_us":281,"thread_start_us":14153,"threads_started":1}
I20260805 22:57:38.778887 11823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.751921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41906 (local address 127.20.34.67:37101)
0805 22:57:38.766172 (+ 14251us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.766182 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.766220 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:57:38.766336 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.766344 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.766601 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.766826 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:38.767837 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.769605 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.774872 (+ 5267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.777713 (+ 2841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.777860 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.778078 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.778310 (+ 232us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.778507 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14002,"thread_start_us":15319,"threads_started":1}
I20260805 22:57:38.779644 11336 tablet_service.cc:1467] Processing CreateTablet for tablet 064620bfb15c4936b8eb79fff5244cc9 (DEFAULT_TABLE table=test-table [id=5ed9a0bae1a14a61a8568c7e4a61bbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:38.780416 11524 tablet_service.cc:1467] Processing CreateTablet for tablet 064620bfb15c4936b8eb79fff5244cc9 (DEFAULT_TABLE table=test-table [id=5ed9a0bae1a14a61a8568c7e4a61bbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:38.781302 11336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 064620bfb15c4936b8eb79fff5244cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:38.781724 11524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 064620bfb15c4936b8eb79fff5244cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:38.782953 11709 tablet_service.cc:1467] Processing CreateTablet for tablet 064620bfb15c4936b8eb79fff5244cc9 (DEFAULT_TABLE table=test-table [id=5ed9a0bae1a14a61a8568c7e4a61bbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:57:38.784482 11709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 064620bfb15c4936b8eb79fff5244cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:57:38.799584 11829 tablet_bootstrap.cc:492] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Bootstrap starting.
I20260805 22:57:38.804531 11828 tablet_bootstrap.cc:492] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: Bootstrap starting.
I20260805 22:57:38.809932 11829 tablet_bootstrap.cc:654] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:38.810256 11828 tablet_bootstrap.cc:654] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:38.811759 11829 log.cc:824] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:38.812734 11828 log.cc:824] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:38.811810 11831 tablet_bootstrap.cc:492] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Bootstrap starting.
I20260805 22:57:38.816941 11831 tablet_bootstrap.cc:654] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Neither blocks nor log segments found. Creating new log.
I20260805 22:57:38.818213 11831 log.cc:824] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Log is configured to *not* fsync() on all Append() calls
I20260805 22:57:38.819341 11829 tablet_bootstrap.cc:492] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: No bootstrap required, opened a new log
I20260805 22:57:38.819571 11828 tablet_bootstrap.cc:492] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: No bootstrap required, opened a new log
I20260805 22:57:38.819666 11829 ts_tablet_manager.cc:1397] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.000s
I20260805 22:57:38.819850 11828 ts_tablet_manager.cc:1397] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260805 22:57:38.821240 11831 tablet_bootstrap.cc:492] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: No bootstrap required, opened a new log
I20260805 22:57:38.821511 11831 ts_tablet_manager.cc:1397] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260805 22:57:38.829481 11831 raft_consensus.cc:348] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.829937 11831 raft_consensus.cc:374] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:38.830083 11831 raft_consensus.cc:729] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e5674814b54303977ced792259cbdf, State: Initialized, Role: FOLLOWER
I20260805 22:57:38.830806 11831 consensus_queue.cc:260] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.831200 11829 raft_consensus.cc:348] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.831202 11828 raft_consensus.cc:348] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.831692 11828 raft_consensus.cc:374] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:38.831773 11829 raft_consensus.cc:374] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:57:38.831848 11828 raft_consensus.cc:729] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16e7ea2340bf4585b5c74ac295f18441, State: Initialized, Role: FOLLOWER
I20260805 22:57:38.831972 11829 raft_consensus.cc:729] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b9cf0f757b439089e583aed8a54918, State: Initialized, Role: FOLLOWER
I20260805 22:57:38.832204 11800 heartbeater.cc:503] Master 127.20.34.126:39757 was elected leader, sending a full tablet report...
I20260805 22:57:38.832571 11828 consensus_queue.cc:260] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.832571 11829 consensus_queue.cc:260] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.834614 11828 ts_tablet_manager.cc:1428] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: Time spent starting tablet: real 0.015s user 0.010s sys 0.003s
I20260805 22:57:38.834872 11829 ts_tablet_manager.cc:1428] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260805 22:57:38.835091 11610 heartbeater.cc:503] Master 127.20.34.126:39757 was elected leader, sending a full tablet report...
I20260805 22:57:38.837563 11831 ts_tablet_manager.cc:1428] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Time spent starting tablet: real 0.016s user 0.012s sys 0.000s
I20260805 22:57:38.886164 11838 raft_consensus.cc:482] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:57:38.886561 11838 raft_consensus.cc:504] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.888497 11838 leader_election.cc:288] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60e5674814b54303977ced792259cbdf (127.20.34.67:37101), 16e7ea2340bf4585b5c74ac295f18441 (127.20.34.66:44971)
I20260805 22:57:38.895758 11825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.889091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:54217 (local address 127.20.34.66:44971)
0805 22:57:38.889356 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.889365 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.890047 (+ 682us) server_negotiation.cc:407] Connection header received
0805 22:57:38.890228 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.890231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.890293 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.890415 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:38.891114 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.891820 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.893899 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.894693 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.894848 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.894939 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.895325 (+ 386us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.895472 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260805 22:57:38.895776 11823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.888940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:44929 (local address 127.20.34.67:37101)
0805 22:57:38.889164 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.889173 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.889892 (+ 719us) server_negotiation.cc:407] Connection header received
0805 22:57:38.890203 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.890214 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.890276 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.890347 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:57:38.891032 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.891817 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.893938 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.894728 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.894940 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.895018 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.895377 (+ 359us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.895511 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:57:38.895920 11842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.889003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:44971 (local address 127.20.34.65:54217)
0805 22:57:38.889930 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:38.889944 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:38.890060 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:38.890459 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:38.890463 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:38.890490 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:38.890916 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.890924 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.891977 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.891984 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.893722 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.893735 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.894931 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.894941 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.895132 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.895180 (+ 48us) client_negotiation.cc:769] Sending connection context
0805 22:57:38.895264 (+ 84us) client_negotiation.cc:240] Negotiation successful
0805 22:57:38.895435 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"mutex_wait_us":85,"thread_start_us":603,"threads_started":1}
I20260805 22:57:38.895982 11843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.888936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:37101 (local address 127.20.34.65:44929)
0805 22:57:38.889759 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:38.889775 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:57:38.889985 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:57:38.890409 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:57:38.890413 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:57:38.890438 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:57:38.890851 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.890861 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.891974 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.891981 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.893730 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:57:38.893742 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.895021 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.895027 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:57:38.895180 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.895202 (+ 22us) client_negotiation.cc:769] Sending connection context
0805 22:57:38.895316 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 22:57:38.895449 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":118,"thread_start_us":444,"threads_started":1}
I20260805 22:57:38.897254 11553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "064620bfb15c4936b8eb79fff5244cc9" candidate_uuid: "81b9cf0f757b439089e583aed8a54918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16e7ea2340bf4585b5c74ac295f18441" is_pre_election: true
I20260805 22:57:38.897282 11735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "064620bfb15c4936b8eb79fff5244cc9" candidate_uuid: "81b9cf0f757b439089e583aed8a54918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e5674814b54303977ced792259cbdf" is_pre_election: true
I20260805 22:57:38.897877 11735 raft_consensus.cc:2454] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b9cf0f757b439089e583aed8a54918 in term 0.
I20260805 22:57:38.897881 11553 raft_consensus.cc:2454] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b9cf0f757b439089e583aed8a54918 in term 0.
I20260805 22:57:38.898718 11276 leader_election.cc:302] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16e7ea2340bf4585b5c74ac295f18441, 60e5674814b54303977ced792259cbdf, 81b9cf0f757b439089e583aed8a54918; no voters:
I20260805 22:57:38.899214 11838 raft_consensus.cc:2781] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:57:38.899346 11838 raft_consensus.cc:482] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:57:38.899493 11838 raft_consensus.cc:3037] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:38.901863 11838 raft_consensus.cc:504] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.902534 11838 leader_election.cc:288] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [CANDIDATE]: Term 1 election: Requested vote from peers 60e5674814b54303977ced792259cbdf (127.20.34.67:37101), 16e7ea2340bf4585b5c74ac295f18441 (127.20.34.66:44971)
I20260805 22:57:38.903113 11553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "064620bfb15c4936b8eb79fff5244cc9" candidate_uuid: "81b9cf0f757b439089e583aed8a54918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16e7ea2340bf4585b5c74ac295f18441"
I20260805 22:57:38.903132 11735 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "064620bfb15c4936b8eb79fff5244cc9" candidate_uuid: "81b9cf0f757b439089e583aed8a54918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e5674814b54303977ced792259cbdf"
I20260805 22:57:38.903322 11553 raft_consensus.cc:3037] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:38.903360 11735 raft_consensus.cc:3037] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:57:38.905772 11553 raft_consensus.cc:2454] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b9cf0f757b439089e583aed8a54918 in term 1.
I20260805 22:57:38.905774 11735 raft_consensus.cc:2454] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b9cf0f757b439089e583aed8a54918 in term 1.
I20260805 22:57:38.906271 11279 leader_election.cc:302] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16e7ea2340bf4585b5c74ac295f18441, 81b9cf0f757b439089e583aed8a54918; no voters:
I20260805 22:57:38.906605 11838 raft_consensus.cc:2781] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:57:38.907166 11838 raft_consensus.cc:686] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 1 LEADER]: Becoming Leader. State: Replica: 81b9cf0f757b439089e583aed8a54918, State: Running, Role: LEADER
I20260805 22:57:38.907809 11838 consensus_queue.cc:237] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:57:38.912819 11167 catalog_manager.cc:5495] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b9cf0f757b439089e583aed8a54918 (127.20.34.65). New cstate: current_term: 1 leader_uuid: "81b9cf0f757b439089e583aed8a54918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } health_report { overall_health: HEALTHY } } }
W20260805 22:57:38.927206 11801 tablet.cc:2369] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:57:38.940845 11827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.935081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59518 (local address 127.20.34.65:40161)
0805 22:57:38.935290 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.935295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.935426 (+ 131us) server_negotiation.cc:407] Connection header received
0805 22:57:38.935620 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.935624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.935766 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.935899 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:57:38.936278 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.937130 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.938593 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:38.938988 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:38.939102 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:38.939623 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:57:38.940267 (+ 644us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:57:38.940387 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:38.940545 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 22:57:38.940631 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 22:57:38.949357 11735 raft_consensus.cc:1261] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 1 FOLLOWER]: Refusing update from remote peer 81b9cf0f757b439089e583aed8a54918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:57:38.949363 11553 raft_consensus.cc:1261] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 1 FOLLOWER]: Refusing update from remote peer 81b9cf0f757b439089e583aed8a54918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:57:38.950448 11838 consensus_queue.cc:1035] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:57:38.950768 11844 consensus_queue.cc:1035] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:57:38.979167 11166 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:57:38.979537 11166 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:57:38.983834 11166 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Sending DeleteTablet for 3 replicas of tablet 064620bfb15c4936b8eb79fff5244cc9
I20260805 22:57:38.985404 11336 tablet_service.cc:1514] Processing DeleteTablet for tablet 064620bfb15c4936b8eb79fff5244cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:38 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:59508
I20260805 22:57:38.985457 11524 tablet_service.cc:1514] Processing DeleteTablet for tablet 064620bfb15c4936b8eb79fff5244cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:38 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:59458
I20260805 22:57:38.985919 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 11255
I20260805 22:57:38.986279 11709 tablet_service.cc:1514] Processing DeleteTablet for tablet 064620bfb15c4936b8eb79fff5244cc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:57:38 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:41906
I20260805 22:57:39.006880 11869 tablet_replica.cc:330] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: stopping tablet replica
I20260805 22:57:39.008075 11868 tablet_replica.cc:330] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: stopping tablet replica
I20260805 22:57:39.008682 11866 tablet_replica.cc:330] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: stopping tablet replica
I20260805 22:57:39.008692 11868 raft_consensus.cc:2229] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:57:39.009217 11866 raft_consensus.cc:2229] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:57:39.009423 11868 raft_consensus.cc:2258] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:39.009737 11869 raft_consensus.cc:2229] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:57:39.010318 11869 raft_consensus.cc:2258] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:39.010586 11866 raft_consensus.cc:2258] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:57:39.012847 11869 ts_tablet_manager.cc:1905] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:39.012979 11868 ts_tablet_manager.cc:1905] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:57:39.014295 11866 ts_tablet_manager.cc:1905] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 05 22:57:39 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:57:39.020210 11869 ts_tablet_manager.cc:1918] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:39.020493 11869 log.cc:1196] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/064620bfb15c4936b8eb79fff5244cc9
I20260805 22:57:39.021149 11869 ts_tablet_manager.cc:1939] T 064620bfb15c4936b8eb79fff5244cc9 P 60e5674814b54303977ced792259cbdf: Deleting consensus metadata
I20260805 22:57:39.022629 11868 ts_tablet_manager.cc:1918] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:39.022887 11868 log.cc:1196] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/064620bfb15c4936b8eb79fff5244cc9
I20260805 22:57:39.023267 11143 catalog_manager.cc:4841] TS 60e5674814b54303977ced792259cbdf (127.20.34.67:37101): tablet 064620bfb15c4936b8eb79fff5244cc9 (table test-table [id=5ed9a0bae1a14a61a8568c7e4a61bbc8]) successfully deleted
I20260805 22:57:39.023610 11868 ts_tablet_manager.cc:1939] T 064620bfb15c4936b8eb79fff5244cc9 P 16e7ea2340bf4585b5c74ac295f18441: Deleting consensus metadata
I20260805 22:57:39.025470 11145 catalog_manager.cc:4841] TS 16e7ea2340bf4585b5c74ac295f18441 (127.20.34.66:44971): tablet 064620bfb15c4936b8eb79fff5244cc9 (table test-table [id=5ed9a0bae1a14a61a8568c7e4a61bbc8]) successfully deleted
I20260805 22:57:39.027068 11827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:38.987230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59532 (local address 127.20.34.65:40161)
0805 22:57:38.987464 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:38.987473 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:38.996532 (+ 9059us) server_negotiation.cc:407] Connection header received
0805 22:57:38.997139 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:38.997148 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:38.997258 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:38.997349 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:39.000067 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:39.001637 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:39.007399 (+ 5762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:39.008280 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:39.008419 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:39.016044 (+ 7625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:39.016059 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:39.016081 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:39.016131 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:39.020403 (+ 4272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:39.022718 (+ 2315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:39.022735 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:39.022740 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:39.023035 (+ 295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:39.024627 (+ 1592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:39.024633 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:39.024636 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:39.025130 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:39.025467 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:39.026169 (+ 702us) server_negotiation.cc:299] Negotiation successful
0805 22:57:39.026456 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 22:57:39.027916 11415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:39.131541 11866 ts_tablet_manager.cc:1918] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:57:39.131855 11866 log.cc:1196] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/064620bfb15c4936b8eb79fff5244cc9
I20260805 22:57:39.132230 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 11255
I20260805 22:57:39.157562 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 11431
W20260805 22:57:39.157615 11145 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.34.65:40161 (error 108)
I20260805 22:57:39.159713 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.159171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59542)
0805 22:57:39.159365 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:39.159512 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260805 22:57:39.160007 11145 catalog_manager.cc:4584] TS 81b9cf0f757b439089e583aed8a54918 (127.20.34.65:40161): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 064620bfb15c4936b8eb79fff5244cc9: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Aug 05 22:57:39 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:57:39.173808 11825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.158520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59472 (local address 127.20.34.66:44971)
0805 22:57:39.158822 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:39.158829 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:39.159120 (+ 291us) server_negotiation.cc:407] Connection header received
0805 22:57:39.159343 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:39.159349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:39.159452 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:39.159572 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:39.161018 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:39.161760 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:39.163226 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:39.163603 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:39.163702 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:39.168139 (+ 4437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:39.168204 (+ 65us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:39.168230 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:39.168263 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:39.171195 (+ 2932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:39.171850 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:39.171857 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:39.171859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:39.171994 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:39.172379 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:39.172383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:39.172385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:39.172773 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:39.173011 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:39.173262 (+ 251us) server_negotiation.cc:299] Negotiation successful
0805 22:57:39.173426 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260805 22:57:39.174501 11604 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:39.213683 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.213097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59554)
0805 22:57:39.213355 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:39.213480 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260805 22:57:39.214766 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.214353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59564)
0805 22:57:39.214516 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:39.214623 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260805 22:57:39.271911 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 11431
I20260805 22:57:39.278039 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.277611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59572)
0805 22:57:39.277800 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:39.277890 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260805 22:57:39.279198 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.278867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59588)
0805 22:57:39.279010 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:39.279081 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260805 22:57:39.297231 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 11618
Aug 05 22:57:39 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:57:39.322388 11823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.298078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41922 (local address 127.20.34.67:37101)
0805 22:57:39.298272 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 22:57:39.298277 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:57:39.298297 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:57:39.298529 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:57:39.298534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:57:39.298615 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:57:39.298786 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:57:39.300108 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:39.300996 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:39.302409 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:57:39.302856 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:57:39.302965 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:57:39.316284 (+ 13319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:57:39.316304 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:57:39.316332 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:57:39.316381 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:57:39.319343 (+ 2962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:39.320070 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:39.320079 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:39.320081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:39.320311 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:57:39.320719 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:57:39.320724 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:57:39.320727 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:57:39.321124 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:57:39.321426 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0805 22:57:39.321789 (+ 363us) server_negotiation.cc:299] Negotiation successful
0805 22:57:39.322043 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:57:39.323066 11794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:39.360535 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.359978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59600)
0805 22:57:39.360243 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:39.360335 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260805 22:57:39.361696 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.361298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59616)
0805 22:57:39.361515 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:39.361586 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260805 22:57:39.416038 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 11618
I20260805 22:57:39.441902 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 11122
I20260805 22:57:39.443060 11207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:57:39.559574 11824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:57:39.558708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:59632)
0805 22:57:39.558965 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0805 22:57:39.559087 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260805 22:57:39.559791 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 11122
I20260805 22:57:59.589931 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39757
--webserver_interface=127.20.34.126
--webserver_port=32967
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:39757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:57:59.974746 11877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:57:59.975147 11877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:57:59.975308 11877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:57:59.983136 11877 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:57:59.983300 11877 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:57:59.983415 11877 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:57:59.983517 11877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:57:59.983623 11877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:57:59.983750 11877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:57:59.983841 11877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:57:59.983934 11877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:57:59.994678 11877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:39757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=32967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:57:59.996269 11877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:57:59.997900 11877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:00.026823 11889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:00.026806 11892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:00.026975 11887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:00.027630 11877 server_base.cc:1034] running on GCE node
I20260805 22:58:00.028952 11877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:00.030758 11877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:00.032047 11877 hybrid_clock.cc:648] HybridClock initialized: now 1785970680031970 us; error 59 us; skew 500 ppm
I20260805 22:58:00.032509 11877 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:00 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970680, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:00.036490 11877 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:58:00.038403 11877 webserver.cc:460] Webserver started at http://127.20.34.126:32967/ using document root <none> and password file <none>
I20260805 22:58:00.039301 11877 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:00.039477 11877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:00.046075 11877 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260805 22:58:00.049669 11901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:00.051278 11877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260805 22:58:00.051523 11877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "46596313e78f41069cec9cc2e0cbe343"
format_stamp: "Formatted at 2026-08-05 22:57:36 on dist-test-slave-gmjp"
server_key: "14d46b02d097257d460f322cbf294bd1"
server_key_iv: "8df923c3140601c21b50e08fe4720928"
server_key_version: "encryptionkey@0"
I20260805 22:58:00.052809 11877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:00.087221 11877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:00.091959 11877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:00.092360 11877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:00.113173 11877 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:39757
I20260805 22:58:00.113173 11967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:39757 every 8 connection(s)
I20260805 22:58:00.115049 11877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:58:00.120555 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 11877
I20260805 22:58:00.121496 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:40161
--local_ip_for_outbound_sockets=127.20.34.65
--tserver_master_addrs=127.20.34.126:39757
--webserver_port=34083
--webserver_interface=127.20.34.65
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:58:00.123095 11968 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:58:00.127211 11968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Bootstrap starting.
I20260805 22:58:00.149221 11968 log.cc:824] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:00.162050 11968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:58:00.162626 11968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Bootstrap complete.
I20260805 22:58:00.172533 11968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:58:00.173508 11968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46596313e78f41069cec9cc2e0cbe343, State: Initialized, Role: FOLLOWER
I20260805 22:58:00.174161 11968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:58:00.174458 11968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:58:00.174603 11968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:58:00.174783 11968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 1 FOLLOWER]: Advancing to term 2
I20260805 22:58:00.178942 11968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:58:00.179505 11968 leader_election.cc:302] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46596313e78f41069cec9cc2e0cbe343; no voters:
I20260805 22:58:00.180256 11968 leader_election.cc:288] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 22:58:00.180437 11973 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 22:58:00.181690 11973 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 2 LEADER]: Becoming Leader. State: Replica: 46596313e78f41069cec9cc2e0cbe343, State: Running, Role: LEADER
I20260805 22:58:00.182395 11973 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:58:00.183012 11968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:58:00.185263 11976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46596313e78f41069cec9cc2e0cbe343. Latest consensus state: current_term: 2 leader_uuid: "46596313e78f41069cec9cc2e0cbe343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } } }
I20260805 22:58:00.185767 11976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:00.186420 11974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "46596313e78f41069cec9cc2e0cbe343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } } }
I20260805 22:58:00.186817 11974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:00.196295 11985 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:58:00.206974 11985 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:58:00.208990 11985 catalog_manager.cc:1259] Loaded cluster ID: 023f839c2c9f4e9f88d8a3eecb4adf0b
I20260805 22:58:00.209203 11985 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:58:00.214843 11985 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:58:00.217248 11985 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Loaded TSK: 0
I20260805 22:58:00.250818 11985 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Generated new TSK 1
I20260805 22:58:00.251241 11985 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:58:00.543262 11971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:00.543570 11971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:00.543802 11971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:00.551802 11971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:00.551932 11971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:00.552119 11971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:58:00.562800 11971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:40161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=34083
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:00.564307 11971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:00.565701 11971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:00.580878 12008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:00.580904 12010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:00.581475 11971 server_base.cc:1034] running on GCE node
W20260805 22:58:00.581554 12007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:00.582515 11971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:00.584030 11971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:00.585330 11971 hybrid_clock.cc:648] HybridClock initialized: now 1785970680585247 us; error 80 us; skew 500 ppm
I20260805 22:58:00.585788 11971 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:00 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970680, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:00.590102 11971 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:58:00.591859 11971 webserver.cc:460] Webserver started at http://127.20.34.65:34083/ using document root <none> and password file <none>
I20260805 22:58:00.592679 11971 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:00.592844 11971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:00.598912 11971 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260805 22:58:00.602088 12020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:00.603585 11971 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:58:00.603780 11971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "81b9cf0f757b439089e583aed8a54918"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "f952fc1c854c285bd5c313cd366c2800"
server_key_iv: "5d3f22c93292bd1a0abc14a81575ac68"
server_key_version: "encryptionkey@0"
I20260805 22:58:00.604904 11971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:00.628650 11971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:00.633507 11971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:00.633828 11971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:00.634956 11971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:00.637224 12031 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260805 22:58:00.642992 12031 ts_tablet_manager.cc:1852] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260805 22:58:00.644009 12031 ts_tablet_manager.cc:1905] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:00.651935 12031 ts_tablet_manager.cc:1918] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:00.652320 12031 ts_tablet_manager.cc:1939] T 064620bfb15c4936b8eb79fff5244cc9 P 81b9cf0f757b439089e583aed8a54918: Deleting consensus metadata
I20260805 22:58:00.652832 11971 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260805 22:58:00.652930 11971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.016s user 0.000s sys 0.001s
I20260805 22:58:00.653039 11971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:00.653097 11971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:00.689850 11971 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:40161
I20260805 22:58:00.689946 12183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:40161 every 8 connection(s)
I20260805 22:58:00.691221 11971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:58:00.698599 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 11971
I20260805 22:58:00.699402 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:44971
--local_ip_for_outbound_sockets=127.20.34.66
--tserver_master_addrs=127.20.34.126:39757
--webserver_port=33407
--webserver_interface=127.20.34.66
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:58:00 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970680, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:00.722184 12187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:00.694421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:37251 (local address 127.20.34.126:39757)
0805 22:58:00.695039 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:00.695059 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:00.695927 (+ 868us) server_negotiation.cc:407] Connection header received
0805 22:58:00.698487 (+ 2560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:00.698502 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:00.698965 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:00.699324 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:00.701733 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:00.703092 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:00.704912 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:00.705578 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:00.705800 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:00.710002 (+ 4202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:00.710012 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:00.710031 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:00.710080 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:00.716274 (+ 6194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:00.717688 (+ 1414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:00.717697 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:00.717704 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:00.717915 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:00.718679 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:00.718684 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:00.718687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:00.719290 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:00.719490 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:00.720738 (+ 1248us) server_negotiation.cc:299] Negotiation successful
0805 22:58:00.721125 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":251,"threads_started":1}
I20260805 22:58:00.722733 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:00.694752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:37251)
0805 22:58:00.695715 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:00.695763 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:00.697705 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:00.699604 (+ 1899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:00.699619 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:00.700558 (+ 939us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:00.701452 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:00.701485 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:00.703325 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:00.703329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:00.704735 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:00.704750 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:00.705860 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:00.705868 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:00.706149 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:00.706920 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:00.706959 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:00.709657 (+ 2698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:00.716545 (+ 6888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:00.716561 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:00.716584 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:00.717469 (+ 885us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:00.718092 (+ 623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:00.718101 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:00.718108 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:00.718483 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:00.719491 (+ 1008us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:00.719504 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:00.720043 (+ 539us) client_negotiation.cc:769] Sending connection context
0805 22:58:00.720517 (+ 474us) client_negotiation.cc:240] Negotiation successful
0805 22:58:00.721235 (+ 718us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":330,"threads_started":1}
I20260805 22:58:00.725960 12185 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39757
I20260805 22:58:00.726318 12185 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:00.727137 12185 heartbeater.cc:511] Master 127.20.34.126:39757 requested a full tablet report, sending...
I20260805 22:58:00.729693 11925 ts_manager.cc:194] Registered new tserver with Master: 81b9cf0f757b439089e583aed8a54918 (127.20.34.65:40161)
I20260805 22:58:00.731315 11925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:37251
W20260805 22:58:01.088788 12191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:01.089174 12191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:01.089375 12191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:01.097321 12191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:01.097527 12191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:01.097735 12191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:58:01.108704 12191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:44971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=33407
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:01.110276 12191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:01.111876 12191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:01.128098 12198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:01.128118 12199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:01.128392 12201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:01.133908 12191 server_base.cc:1034] running on GCE node
I20260805 22:58:01.134708 12191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:01.135932 12191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:01.137219 12191 hybrid_clock.cc:648] HybridClock initialized: now 1785970681137181 us; error 61 us; skew 500 ppm
I20260805 22:58:01.137615 12191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:01 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970681, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:01.141101 12191 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:58:01.142712 12191 webserver.cc:460] Webserver started at http://127.20.34.66:33407/ using document root <none> and password file <none>
I20260805 22:58:01.143496 12191 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:01.143671 12191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:01.149447 12191 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260805 22:58:01.152423 12211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:01.153924 12191 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 22:58:01.154119 12191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "16e7ea2340bf4585b5c74ac295f18441"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "2d996fc7e9b89e2b50e4143cbb15ba14"
server_key_iv: "9faacfac6a837cd9133efad25904255f"
server_key_version: "encryptionkey@0"
I20260805 22:58:01.155197 12191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:01.175428 12191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:01.179759 12191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:01.180068 12191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:01.181198 12191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:01.182931 12191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:01.183120 12191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260805 22:58:01.183249 12191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:01.183336 12191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:01.223802 12191 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:44971
I20260805 22:58:01.223824 12362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:44971 every 8 connection(s)
I20260805 22:58:01.225539 12191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:58:01.231652 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 12191
I20260805 22:58:01.232533 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:37101
--local_ip_for_outbound_sockets=127.20.34.67
--tserver_master_addrs=127.20.34.126:39757
--webserver_port=43025
--webserver_interface=127.20.34.67
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 22:58:01 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970681, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:01.250380 12366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.228328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:43047 (local address 127.20.34.126:39757)
0805 22:58:01.228840 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:01.228845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:01.229715 (+ 870us) server_negotiation.cc:407] Connection header received
0805 22:58:01.231913 (+ 2198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:01.231918 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:01.231991 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:01.232092 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:01.234444 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.235225 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.237981 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.238406 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.238525 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.243488 (+ 4963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:01.243493 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:01.243497 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:01.243535 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:01.246335 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:01.247505 (+ 1170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:01.247511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:01.247515 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:01.247758 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:01.248401 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:01.248406 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:01.248410 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:01.248734 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:01.248912 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:01.249705 (+ 793us) server_negotiation.cc:299] Negotiation successful
0805 22:58:01.249989 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":265,"threads_started":1}
I20260805 22:58:01.251632 12367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.228796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:43047)
0805 22:58:01.229540 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:01.229587 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:01.231551 (+ 1964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:01.232445 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:01.232458 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:01.233300 (+ 842us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:01.234212 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.234245 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.235445 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.235453 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.237807 (+ 2354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.237826 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.238677 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.238687 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.239068 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.239895 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:01.239957 (+ 62us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:01.243183 (+ 3226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:01.246497 (+ 3314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:01.246510 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:01.246535 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:01.247292 (+ 757us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:01.247901 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:01.247908 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:01.247913 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:01.248269 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:01.248879 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:01.248888 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:01.249299 (+ 411us) client_negotiation.cc:769] Sending connection context
0805 22:58:01.249610 (+ 311us) client_negotiation.cc:240] Negotiation successful
0805 22:58:01.250222 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":284,"threads_started":1}
I20260805 22:58:01.253446 12364 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39757
I20260805 22:58:01.253789 12364 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:01.254596 12364 heartbeater.cc:511] Master 127.20.34.126:39757 requested a full tablet report, sending...
I20260805 22:58:01.256320 11925 ts_manager.cc:194] Registered new tserver with Master: 16e7ea2340bf4585b5c74ac295f18441 (127.20.34.66:44971)
I20260805 22:58:01.257320 11925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:43047
W20260805 22:58:01.610358 12368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:01.610798 12368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:01.610970 12368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:01.618746 12368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:01.618942 12368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:01.619138 12368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:58:01.629508 12368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:37101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=43025
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:01.631034 12368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:01.632580 12368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:01.647919 12375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:01.647956 12374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:01.648059 12377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:01.649206 12368 server_base.cc:1034] running on GCE node
I20260805 22:58:01.649948 12368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:01.651067 12368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:01.652300 12368 hybrid_clock.cc:648] HybridClock initialized: now 1785970681652245 us; error 59 us; skew 500 ppm
I20260805 22:58:01.652680 12368 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:01 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970681, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:01.656262 12368 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:58:01.657992 12368 webserver.cc:460] Webserver started at http://127.20.34.67:43025/ using document root <none> and password file <none>
I20260805 22:58:01.658730 12368 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:01.658893 12368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:01.664958 12368 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:58:01.667958 12389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:01.669499 12368 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 22:58:01.669719 12368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "60e5674814b54303977ced792259cbdf"
format_stamp: "Formatted at 2026-08-05 22:57:38 on dist-test-slave-gmjp"
server_key: "6deb5b363432d8c96dfdb8429e757ed0"
server_key_iv: "8f24c246ff76b279b07be2485c5a81f0"
server_key_version: "encryptionkey@0"
I20260805 22:58:01.670792 12368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:01.695315 12368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:01.700448 12368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:01.700794 12368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:01.701972 12368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:01.703548 12368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:01.703649 12368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:01.703788 12368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:01.703871 12368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:01.735111 12185 heartbeater.cc:503] Master 127.20.34.126:39757 was elected leader, sending a full tablet report...
I20260805 22:58:01.741582 12368 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:37101
I20260805 22:58:01.741670 12574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:37101 every 8 connection(s)
I20260805 22:58:01.743162 12368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:58:01.753044 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 12368
Aug 05 22:58:01 dist-test-slave-gmjp krb5kdc[11097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970681, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:01.767799 12366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.746065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:56889 (local address 127.20.34.126:39757)
0805 22:58:01.746294 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:01.746301 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:01.747644 (+ 1343us) server_negotiation.cc:407] Connection header received
0805 22:58:01.749931 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:01.749936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:01.750018 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:01.750120 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:01.752084 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.753338 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.755957 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.756712 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.756866 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.761402 (+ 4536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:01.761408 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:01.761411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:01.761449 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:01.764441 (+ 2992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:01.765264 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:01.765271 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:01.765288 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:01.765412 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:01.765899 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:01.765905 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:01.765908 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:01.766243 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:01.766440 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:01.767196 (+ 756us) server_negotiation.cc:299] Negotiation successful
0805 22:58:01.767457 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 22:58:01.769349 12578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.746623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:56889)
0805 22:58:01.747455 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:01.747502 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:01.749506 (+ 2004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:01.750397 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:01.750406 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:01.751078 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:01.751803 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.751826 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.753575 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.753579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.755796 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.755809 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.756941 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.756947 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.757215 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.758036 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:01.758070 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:01.761155 (+ 3085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:01.764596 (+ 3441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:01.764607 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:01.764633 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:01.765138 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:01.765542 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:01.765553 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:01.765555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:01.765763 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:01.766400 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:01.766409 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:01.766813 (+ 404us) client_negotiation.cc:769] Sending connection context
0805 22:58:01.767111 (+ 298us) client_negotiation.cc:240] Negotiation successful
0805 22:58:01.767706 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":315,"threads_started":1}
I20260805 22:58:01.770686 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.754338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56326 (local address 127.20.34.126:39757)
0805 22:58:01.755251 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:01.755258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:01.755277 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:58:01.755328 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:01.755333 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:01.755412 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:01.755533 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:01.757735 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.759063 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.760823 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.761292 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.761444 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.764698 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:01.764704 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:01.764707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:01.764746 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:01.767384 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:01.768323 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:01.768331 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:01.768337 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:01.768486 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:01.768888 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:01.768895 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:01.768901 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:01.769300 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:01.769605 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:01.770012 (+ 407us) server_negotiation.cc:299] Negotiation successful
0805 22:58:01.770262 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":635,"threads_started":1}
I20260805 22:58:01.771126 12575 heartbeater.cc:347] Connected to a master server at 127.20.34.126:39757
I20260805 22:58:01.771524 12575 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:01.772475 12575 heartbeater.cc:511] Master 127.20.34.126:39757 requested a full tablet report, sending...
I20260805 22:58:01.773993 11925 ts_manager.cc:194] Registered new tserver with Master: 60e5674814b54303977ced792259cbdf (127.20.34.67:37101)
I20260805 22:58:01.774791 11925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:56889
I20260805 22:58:01.786312 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:58:01.793474 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.787344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56332 (local address 127.20.34.126:39757)
0805 22:58:01.787637 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:01.787645 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:01.788044 (+ 399us) server_negotiation.cc:407] Connection header received
0805 22:58:01.788303 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:01.788307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:01.788472 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:01.788615 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:58:01.789065 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.789779 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.791410 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.791910 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.792025 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.792573 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:58:01.792827 (+ 254us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0805 22:58:01.793138 (+ 311us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56332: token expired
Metrics: {"server-negotiator.queue_time_us":93}
W20260805 22:58:01.793632 12581 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56332: token expired
W20260805 22:58:01.794234 11808 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.34.126:39757)
I20260805 22:58:01.809156 12581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.794693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56344 (local address 127.20.34.126:39757)
0805 22:58:01.794886 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:01.794894 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:01.794914 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:58:01.795097 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:01.795107 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:01.795168 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:01.795272 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:01.796915 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.797708 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.799820 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.800349 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.800469 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.803366 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:01.803372 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:01.803375 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:01.803421 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:01.806394 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:01.807127 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:01.807132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:01.807134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:01.807305 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:01.807676 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:01.807679 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:01.807681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:01.808030 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:01.808304 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:01.808674 (+ 370us) server_negotiation.cc:299] Negotiation successful
0805 22:58:01.808871 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:58:01.813007 11925 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:58:01.820955 11925 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:58:01.845615 12592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.834699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:44971 (local address 127.0.0.1:46838)
0805 22:58:01.836339 (+ 1640us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:01.836357 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:01.836480 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:01.837525 (+ 1045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:01.837532 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:01.837572 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:01.838099 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.838112 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.839611 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.839619 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.842569 (+ 2950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.842582 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.844393 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.844399 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.844612 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.844670 (+ 58us) client_negotiation.cc:769] Sending connection context
0805 22:58:01.844819 (+ 149us) client_negotiation.cc:240] Negotiation successful
0805 22:58:01.845060 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1510,"mutex_wait_us":1,"thread_start_us":1522,"threads_started":1}
I20260805 22:58:01.846455 12595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.835298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46838 (local address 127.20.34.66:44971)
0805 22:58:01.836383 (+ 1085us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:01.836397 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:01.836438 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:58:01.836709 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:01.836721 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:01.837012 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:01.837226 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:01.838326 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.839467 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.842744 (+ 3277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.844100 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.844273 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.844505 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:01.846054 (+ 1549us) server_negotiation.cc:299] Negotiation successful
0805 22:58:01.846231 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":834,"thread_start_us":710,"threads_started":1}
I20260805 22:58:01.845999 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.836649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:49760)
0805 22:58:01.837263 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:01.837281 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:01.837404 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:01.838584 (+ 1180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:01.838590 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:01.838616 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:01.839024 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.839037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.841198 (+ 2161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.841204 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.843421 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.843431 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.845177 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.845184 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.845396 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.845437 (+ 41us) client_negotiation.cc:769] Sending connection context
0805 22:58:01.845511 (+ 74us) client_negotiation.cc:240] Negotiation successful
0805 22:58:01.845668 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":815,"threads_started":1}
I20260805 22:58:01.846833 12594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.834861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42262 (local address 127.20.34.67:37101)
0805 22:58:01.837014 (+ 2153us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:01.837024 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:01.837058 (+ 34us) server_negotiation.cc:407] Connection header received
0805 22:58:01.837174 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:01.837182 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:01.837413 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:01.838389 (+ 976us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:01.838889 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.840607 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.843350 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.845132 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.845932 (+ 800us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.846190 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:01.846268 (+ 78us) server_negotiation.cc:299] Negotiation successful
0805 22:58:01.846462 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1960,"thread_start_us":1802,"threads_started":1}
I20260805 22:58:01.846271 12590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.834591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:37101 (local address 127.0.0.1:42262)
0805 22:58:01.835444 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:01.835501 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:01.835709 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:01.837660 (+ 1951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:01.837666 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:01.837703 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:01.838176 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.838190 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.840789 (+ 2599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.840795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.843173 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:01.843189 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.845418 (+ 2229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.845424 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:01.845618 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.845652 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:58:01.845719 (+ 67us) client_negotiation.cc:240] Negotiation successful
0805 22:58:01.845867 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":435,"threads_started":1}
I20260805 22:58:01.847241 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:01.837265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49760 (local address 127.20.34.65:40161)
0805 22:58:01.837951 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:01.837959 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:01.837986 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:58:01.838088 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:01.838097 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:01.838325 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:01.839244 (+ 919us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:01.839489 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.841034 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.843587 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:01.844916 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:01.846404 (+ 1488us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:01.846627 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:01.846712 (+ 85us) server_negotiation.cc:299] Negotiation successful
0805 22:58:01.846902 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":1205,"threads_started":1}
I20260805 22:58:01.849361 12094 tablet_service.cc:1467] Processing CreateTablet for tablet ae7f2c9e867f42c3942915933957e0a7 (DEFAULT_TABLE table=test-table [id=4bf8f045a3b749de81bd3510fa4c21c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:01.850924 12094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae7f2c9e867f42c3942915933957e0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:01.850914 12285 tablet_service.cc:1467] Processing CreateTablet for tablet ae7f2c9e867f42c3942915933957e0a7 (DEFAULT_TABLE table=test-table [id=4bf8f045a3b749de81bd3510fa4c21c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:01.850984 12471 tablet_service.cc:1467] Processing CreateTablet for tablet ae7f2c9e867f42c3942915933957e0a7 (DEFAULT_TABLE table=test-table [id=4bf8f045a3b749de81bd3510fa4c21c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:01.852260 12285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae7f2c9e867f42c3942915933957e0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:01.852571 12471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae7f2c9e867f42c3942915933957e0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:01.866816 12599 tablet_bootstrap.cc:492] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Bootstrap starting.
I20260805 22:58:01.869741 12598 tablet_bootstrap.cc:492] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Bootstrap starting.
I20260805 22:58:01.871630 12599 tablet_bootstrap.cc:654] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:01.872987 12600 tablet_bootstrap.cc:492] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Bootstrap starting.
I20260805 22:58:01.873139 12599 log.cc:824] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:01.873649 12598 tablet_bootstrap.cc:654] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:01.874989 12598 log.cc:824] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:01.876766 12600 tablet_bootstrap.cc:654] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:01.877018 12599 tablet_bootstrap.cc:492] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: No bootstrap required, opened a new log
I20260805 22:58:01.877322 12599 ts_tablet_manager.cc:1397] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260805 22:58:01.877974 12598 tablet_bootstrap.cc:492] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: No bootstrap required, opened a new log
I20260805 22:58:01.878012 12600 log.cc:824] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:01.878345 12598 ts_tablet_manager.cc:1397] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260805 22:58:01.886639 12600 tablet_bootstrap.cc:492] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: No bootstrap required, opened a new log
I20260805 22:58:01.886587 12598 raft_consensus.cc:348] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:01.886976 12600 ts_tablet_manager.cc:1397] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260805 22:58:01.887099 12598 raft_consensus.cc:374] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:01.887209 12598 raft_consensus.cc:729] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b9cf0f757b439089e583aed8a54918, State: Initialized, Role: FOLLOWER
I20260805 22:58:01.887900 12598 consensus_queue.cc:260] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:01.889483 12599 raft_consensus.cc:348] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:01.889837 12598 ts_tablet_manager.cc:1428] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260805 22:58:01.890031 12599 raft_consensus.cc:374] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:01.890184 12599 raft_consensus.cc:729] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16e7ea2340bf4585b5c74ac295f18441, State: Initialized, Role: FOLLOWER
I20260805 22:58:01.891079 12599 consensus_queue.cc:260] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:01.892446 12364 heartbeater.cc:503] Master 127.20.34.126:39757 was elected leader, sending a full tablet report...
I20260805 22:58:01.894472 12599 ts_tablet_manager.cc:1428] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
I20260805 22:58:01.897987 12600 raft_consensus.cc:348] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:01.898455 12600 raft_consensus.cc:374] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:01.898587 12600 raft_consensus.cc:729] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e5674814b54303977ced792259cbdf, State: Initialized, Role: FOLLOWER
I20260805 22:58:01.899178 12600 consensus_queue.cc:260] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:01.900293 12575 heartbeater.cc:503] Master 127.20.34.126:39757 was elected leader, sending a full tablet report...
I20260805 22:58:01.901065 12600 ts_tablet_manager.cc:1428] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Time spent starting tablet: real 0.014s user 0.011s sys 0.005s
W20260805 22:58:01.944057 12186 tablet.cc:2369] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:58:01.977767 12365 tablet.cc:2369] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:58:01.995047 12577 tablet.cc:2369] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:58:02.095849 12606 raft_consensus.cc:482] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:58:02.096326 12606 raft_consensus.cc:504] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:02.098850 12606 leader_election.cc:288] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60e5674814b54303977ced792259cbdf (127.20.34.67:37101), 16e7ea2340bf4585b5c74ac295f18441 (127.20.34.66:44971)
I20260805 22:58:02.105993 12594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.099329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:35067 (local address 127.20.34.67:37101)
0805 22:58:02.099577 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:02.099584 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:02.100501 (+ 917us) server_negotiation.cc:407] Connection header received
0805 22:58:02.100767 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:02.100777 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:02.100842 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:02.100951 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:02.101489 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.102259 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.104211 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.105026 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.105232 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:02.105312 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:02.105593 (+ 281us) server_negotiation.cc:299] Negotiation successful
0805 22:58:02.105724 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 22:58:02.106168 12609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.099203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:37101 (local address 127.20.34.65:35067)
0805 22:58:02.100358 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.100378 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:02.100598 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:02.100972 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:02.100977 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:02.101002 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:02.101336 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:02.101345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.102412 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.102419 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:02.104018 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:02.104031 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.105249 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.105255 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:02.105420 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:02.105445 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:58:02.105554 (+ 109us) client_negotiation.cc:240] Negotiation successful
0805 22:58:02.105698 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1038,"mutex_wait_us":23,"thread_start_us":549,"threads_started":1}
I20260805 22:58:02.106655 12595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.099375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:39569 (local address 127.20.34.66:44971)
0805 22:58:02.099801 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:02.099808 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:02.100795 (+ 987us) server_negotiation.cc:407] Connection header received
0805 22:58:02.101038 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:02.101044 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:02.101112 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:02.101228 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:02.101876 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.102720 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.104711 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.105568 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.105802 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:02.105889 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:02.106281 (+ 392us) server_negotiation.cc:299] Negotiation successful
0805 22:58:02.106442 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244}
I20260805 22:58:02.107612 12610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.099546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:44971 (local address 127.20.34.65:39569)
0805 22:58:02.100650 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.100667 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:02.100866 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:02.101255 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:02.101259 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:02.101293 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:02.101679 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:02.101692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.102883 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.102890 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:02.104521 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:02.104535 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.105825 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.105833 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:02.106022 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:02.106047 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 22:58:02.106983 (+ 936us) client_negotiation.cc:240] Negotiation successful
0805 22:58:02.107146 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":959,"mutex_wait_us":27,"thread_start_us":753,"threads_started":1}
I20260805 22:58:02.107501 12506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae7f2c9e867f42c3942915933957e0a7" candidate_uuid: "81b9cf0f757b439089e583aed8a54918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e5674814b54303977ced792259cbdf" is_pre_election: true
I20260805 22:58:02.108309 12506 raft_consensus.cc:2454] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b9cf0f757b439089e583aed8a54918 in term 0.
I20260805 22:58:02.108958 12307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae7f2c9e867f42c3942915933957e0a7" candidate_uuid: "81b9cf0f757b439089e583aed8a54918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16e7ea2340bf4585b5c74ac295f18441" is_pre_election: true
I20260805 22:58:02.109159 12021 leader_election.cc:302] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e5674814b54303977ced792259cbdf, 81b9cf0f757b439089e583aed8a54918; no voters:
I20260805 22:58:02.109611 12606 raft_consensus.cc:2781] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:58:02.109660 12307 raft_consensus.cc:2454] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b9cf0f757b439089e583aed8a54918 in term 0.
I20260805 22:58:02.109825 12606 raft_consensus.cc:482] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:58:02.110002 12606 raft_consensus.cc:3037] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:02.112833 12606 raft_consensus.cc:504] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:02.113649 12606 leader_election.cc:288] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [CANDIDATE]: Term 1 election: Requested vote from peers 60e5674814b54303977ced792259cbdf (127.20.34.67:37101), 16e7ea2340bf4585b5c74ac295f18441 (127.20.34.66:44971)
I20260805 22:58:02.114144 12506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae7f2c9e867f42c3942915933957e0a7" candidate_uuid: "81b9cf0f757b439089e583aed8a54918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e5674814b54303977ced792259cbdf"
I20260805 22:58:02.114423 12506 raft_consensus.cc:3037] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:02.114555 12307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae7f2c9e867f42c3942915933957e0a7" candidate_uuid: "81b9cf0f757b439089e583aed8a54918" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16e7ea2340bf4585b5c74ac295f18441"
I20260805 22:58:02.114780 12307 raft_consensus.cc:3037] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:02.117311 12506 raft_consensus.cc:2454] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b9cf0f757b439089e583aed8a54918 in term 1.
I20260805 22:58:02.118300 12021 leader_election.cc:302] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e5674814b54303977ced792259cbdf, 81b9cf0f757b439089e583aed8a54918; no voters:
I20260805 22:58:02.118428 12307 raft_consensus.cc:2454] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b9cf0f757b439089e583aed8a54918 in term 1.
I20260805 22:58:02.118906 12606 raft_consensus.cc:2781] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:02.119653 12606 raft_consensus.cc:686] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 1 LEADER]: Becoming Leader. State: Replica: 81b9cf0f757b439089e583aed8a54918, State: Running, Role: LEADER
I20260805 22:58:02.120487 12606 consensus_queue.cc:237] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } }
I20260805 22:58:02.126753 11924 catalog_manager.cc:5495] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b9cf0f757b439089e583aed8a54918 (127.20.34.65). New cstate: current_term: 1 leader_uuid: "81b9cf0f757b439089e583aed8a54918" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b9cf0f757b439089e583aed8a54918" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 40161 } health_report { overall_health: HEALTHY } } }
I20260805 22:58:02.147548 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.141875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49776 (local address 127.20.34.65:40161)
0805 22:58:02.142148 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:02.142153 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:02.142176 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:58:02.142337 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:02.142341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:02.142433 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:02.142592 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:58:02.142967 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.143759 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.145198 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.145616 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.145719 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:02.146325 (+ 606us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:58:02.146860 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:58:02.146981 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:02.147112 (+ 131us) server_negotiation.cc:299] Negotiation successful
0805 22:58:02.147202 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260805 22:58:02.156421 12506 raft_consensus.cc:1261] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 1 FOLLOWER]: Refusing update from remote peer 81b9cf0f757b439089e583aed8a54918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:02.156421 12307 raft_consensus.cc:1261] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 1 FOLLOWER]: Refusing update from remote peer 81b9cf0f757b439089e583aed8a54918: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:02.157545 12611 consensus_queue.cc:1035] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16e7ea2340bf4585b5c74ac295f18441" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 44971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:02.157966 12606 consensus_queue.cc:1035] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e5674814b54303977ced792259cbdf" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:02.189903 11924 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:02.190253 11924 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56344:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:02.193919 11924 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Sending DeleteTablet for 3 replicas of tablet ae7f2c9e867f42c3942915933957e0a7
I20260805 22:58:02.195350 12094 tablet_service.cc:1514] Processing DeleteTablet for tablet ae7f2c9e867f42c3942915933957e0a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:49760
I20260805 22:58:02.195488 12285 tablet_service.cc:1514] Processing DeleteTablet for tablet ae7f2c9e867f42c3942915933957e0a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:46838
I20260805 22:58:02.195750 12471 tablet_service.cc:1514] Processing DeleteTablet for tablet ae7f2c9e867f42c3942915933957e0a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:02 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:42262
I20260805 22:58:02.196628 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 11971
I20260805 22:58:02.208240 12633 tablet_replica.cc:330] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: stopping tablet replica
I20260805 22:58:02.209656 12633 raft_consensus.cc:2229] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:58:02.211463 12635 tablet_replica.cc:330] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: stopping tablet replica
I20260805 22:58:02.211406 12633 raft_consensus.cc:2258] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:02.212019 12635 raft_consensus.cc:2229] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:02.213208 12635 raft_consensus.cc:2258] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:02.214190 12634 tablet_replica.cc:330] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: stopping tablet replica
I20260805 22:58:02.214736 12633 ts_tablet_manager.cc:1905] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:02.216529 12634 raft_consensus.cc:2229] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:02.217326 12635 ts_tablet_manager.cc:1905] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:02.220909 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.197688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49790 (local address 127.20.34.65:40161)
0805 22:58:02.197934 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:02.197944 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:02.198048 (+ 104us) server_negotiation.cc:407] Connection header received
0805 22:58:02.198306 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:02.198315 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:02.198416 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:02.198553 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:02.200902 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.202547 (+ 1645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.205284 (+ 2737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.206269 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.206449 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:02.210953 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:02.210974 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:02.211003 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:02.211096 (+ 93us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:02.215861 (+ 4765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:02.217108 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:02.217118 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:02.217122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:02.217366 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:02.217930 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:02.217935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:02.217939 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:02.218499 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:02.218843 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:02.220213 (+ 1370us) server_negotiation.cc:299] Negotiation successful
0805 22:58:02.220505 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 22:58:02.221688 12176 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:02.225147 12635 ts_tablet_manager.cc:1918] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:02.225440 12635 log.cc:1196] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/ae7f2c9e867f42c3942915933957e0a7
I20260805 22:58:02.226428 12635 ts_tablet_manager.cc:1939] T ae7f2c9e867f42c3942915933957e0a7 P 60e5674814b54303977ced792259cbdf: Deleting consensus metadata
I20260805 22:58:02.222685 12634 raft_consensus.cc:2258] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:02.229295 11902 catalog_manager.cc:4841] TS 60e5674814b54303977ced792259cbdf (127.20.34.67:37101): tablet ae7f2c9e867f42c3942915933957e0a7 (table test-table [id=4bf8f045a3b749de81bd3510fa4c21c8]) successfully deleted
I20260805 22:58:02.231246 12634 ts_tablet_manager.cc:1905] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:02.236923 12634 ts_tablet_manager.cc:1918] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:02.237144 12634 log.cc:1196] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/ae7f2c9e867f42c3942915933957e0a7
I20260805 22:58:02.237730 12634 ts_tablet_manager.cc:1939] T ae7f2c9e867f42c3942915933957e0a7 P 16e7ea2340bf4585b5c74ac295f18441: Deleting consensus metadata
I20260805 22:58:02.239535 11905 catalog_manager.cc:4841] TS 16e7ea2340bf4585b5c74ac295f18441 (127.20.34.66:44971): tablet ae7f2c9e867f42c3942915933957e0a7 (table test-table [id=4bf8f045a3b749de81bd3510fa4c21c8]) successfully deleted
I20260805 22:58:02.336500 12633 ts_tablet_manager.cc:1918] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:02.336850 12633 log.cc:1196] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/ae7f2c9e867f42c3942915933957e0a7
I20260805 22:58:02.337329 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 11971
W20260805 22:58:02.368214 11905 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.34.65:40161 (error 108)
I20260805 22:58:02.368446 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 12191
I20260805 22:58:02.370541 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.369632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:54818)
0805 22:58:02.370177 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.370335 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":287,"threads_started":1}
W20260805 22:58:02.370801 11905 catalog_manager.cc:4584] TS 81b9cf0f757b439089e583aed8a54918 (127.20.34.65:40161): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ae7f2c9e867f42c3942915933957e0a7: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
I20260805 22:58:02.383836 12595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.369502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50616 (local address 127.20.34.66:44971)
0805 22:58:02.369681 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:02.369686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:02.369704 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:58:02.369889 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:02.369897 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:02.369999 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:02.370122 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:02.371731 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.372633 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.374114 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.374627 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.374767 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:02.377692 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:02.377711 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:02.377731 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:02.377766 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:02.380835 (+ 3069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:02.381581 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:02.381589 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:02.381591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:02.381721 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:02.382092 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:02.382095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:02.382097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:02.382516 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:02.382759 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:02.383162 (+ 403us) server_negotiation.cc:299] Negotiation successful
0805 22:58:02.383408 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 22:58:02.384804 12358 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:02.424603 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.423977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:54822)
0805 22:58:02.424323 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.424439 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260805 22:58:02.425776 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.425408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:54826)
0805 22:58:02.425546 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.425622 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260805 22:58:02.479423 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 12191
I20260805 22:58:02.486873 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.486145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:54840)
0805 22:58:02.486456 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.486629 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260805 22:58:02.488308 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.487821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:54852)
0805 22:58:02.488003 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.488081 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260805 22:58:02.511113 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 12368
I20260805 22:58:02.526687 12594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.512056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54000 (local address 127.20.34.67:37101)
0805 22:58:02.512253 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:02.512258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:02.512281 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:58:02.512467 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:02.512471 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:02.512551 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:02.512639 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:02.514219 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.515021 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.516738 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:02.517194 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:02.517319 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:02.520583 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:02.520600 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:02.520619 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:02.520660 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:02.523704 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:02.524733 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:02.524742 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:02.524744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:02.524923 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:02.525280 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:02.525283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:02.525285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:02.525699 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:02.525943 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:02.526223 (+ 280us) server_negotiation.cc:299] Negotiation successful
0805 22:58:02.526413 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 22:58:02.527379 12569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:02.569461 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.568831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:54862)
0805 22:58:02.569105 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.569220 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260805 22:58:02.570691 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.570195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:54864)
0805 22:58:02.570442 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.570524 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260805 22:58:02.618880 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 12368
I20260805 22:58:02.646728 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 11877
I20260805 22:58:02.648237 11963 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:02.768013 12639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:02.767336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:40161 (local address 127.0.0.1:54872)
0805 22:58:02.767545 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:02.767708 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:40161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260805 22:58:02.768409 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 11877
I20260805 22:58:22.803125 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39757
--webserver_interface=127.20.34.126
--webserver_port=32967
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:39757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:58:23.172201 12643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:23.172605 12643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:23.172773 12643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:23.180294 12643 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 22:58:23.180435 12643 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 22:58:23.180529 12643 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 22:58:23.180629 12643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:58:23.180734 12643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:23.180861 12643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:23.180958 12643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:58:23.181041 12643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:58:23.194864 12643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:39757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=32967
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:23.196384 12643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:23.197785 12643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:23.210986 12656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:23.211115 12658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:23.211140 12652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:23.211422 12643 server_base.cc:1034] running on GCE node
I20260805 22:58:23.212507 12643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:23.213934 12643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:23.215188 12643 hybrid_clock.cc:648] HybridClock initialized: now 1785970703215116 us; error 47 us; skew 500 ppm
I20260805 22:58:23.215538 12643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:23 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:23.218994 12643 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:58:23.220752 12643 webserver.cc:460] Webserver started at http://127.20.34.126:32967/ using document root <none> and password file <none>
I20260805 22:58:23.221539 12643 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:23.221690 12643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:23.227578 12643 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260805 22:58:23.230855 12666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:23.232443 12643 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:58:23.232645 12643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "46596313e78f41069cec9cc2e0cbe343"
format_stamp: "Formatted at 2026-08-05 22:57:36 on dist-test-slave-gmjp"
server_key: "14d46b02d097257d460f322cbf294bd1"
server_key_iv: "8df923c3140601c21b50e08fe4720928"
server_key_version: "encryptionkey@0"
I20260805 22:58:23.233714 12643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:23.254038 12643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:23.258508 12643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:23.258816 12643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:23.278517 12643 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:39757
I20260805 22:58:23.278537 12744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:39757 every 8 connection(s)
I20260805 22:58:23.280107 12643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:58:23.281623 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 12643
I20260805 22:58:23.282675 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:40161
--local_ip_for_outbound_sockets=127.20.34.65
--tserver_master_addrs=127.20.34.126:39757
--webserver_port=34083
--webserver_interface=127.20.34.65
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:58:23.287684 12746 sys_catalog.cc:263] Verifying existing consensus state
I20260805 22:58:23.291002 12746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Bootstrap starting.
I20260805 22:58:23.312826 12746 log.cc:824] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:23.329605 12746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 22:58:23.330205 12746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Bootstrap complete.
I20260805 22:58:23.340378 12746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:58:23.341347 12746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46596313e78f41069cec9cc2e0cbe343, State: Initialized, Role: FOLLOWER
I20260805 22:58:23.342049 12746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:58:23.342316 12746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:58:23.342445 12746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:58:23.342643 12746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 2 FOLLOWER]: Advancing to term 3
I20260805 22:58:23.346709 12746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:58:23.347268 12746 leader_election.cc:302] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46596313e78f41069cec9cc2e0cbe343; no voters:
I20260805 22:58:23.348002 12746 leader_election.cc:288] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260805 22:58:23.348170 12752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 22:58:23.349586 12752 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [term 3 LEADER]: Becoming Leader. State: Replica: 46596313e78f41069cec9cc2e0cbe343, State: Running, Role: LEADER
I20260805 22:58:23.350301 12752 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } }
I20260805 22:58:23.350538 12746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:58:23.353255 12754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "46596313e78f41069cec9cc2e0cbe343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } } }
I20260805 22:58:23.353752 12754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:23.356181 12755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46596313e78f41069cec9cc2e0cbe343. Latest consensus state: current_term: 3 leader_uuid: "46596313e78f41069cec9cc2e0cbe343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46596313e78f41069cec9cc2e0cbe343" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39757 } } }
I20260805 22:58:23.356714 12755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:23.358693 12761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:58:23.370216 12761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:58:23.372040 12761 catalog_manager.cc:1259] Loaded cluster ID: 023f839c2c9f4e9f88d8a3eecb4adf0b
I20260805 22:58:23.372288 12761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:58:23.376833 12761 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:58:23.378826 12761 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Loaded TSK: 0
I20260805 22:58:23.379109 12761 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 46596313e78f41069cec9cc2e0cbe343: Loaded TSK: 1
F20260805 22:58:23.380429 12761 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2848fd79ad google::LogMessage::Fail() at ??:0
@ 0x7f2848fda88a google::LogMessage::SendToLog() at ??:0
@ 0x7f2848fd74de google::LogMessage::Flush() at ??:0
@ 0x7f2848fd8a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f284cd3b7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f284cd2a73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f285ea061c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f285ea05783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f285ea912a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f285ea910c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f285eadb5e9 std::function<>::operator()() at ??:0
@ 0x7f285ea09cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f285ea07c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f285ea8f610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f285ea8f439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f284bc23345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f284bc2691c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f284bc26799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f284bc01eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f284eedb6db start_thread at ??:0
@ 0x7f2847e7161f clone at ??:0
W20260805 22:58:23.718814 12750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:23.719130 12750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:23.719235 12750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:23.726945 12750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:23.727083 12750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:23.727210 12750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:58:23.737591 12750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:40161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=34083
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:23.738987 12750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:23.740398 12750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:23.754184 12813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:23.754271 12811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:23.754240 12810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:23.755384 12750 server_base.cc:1034] running on GCE node
I20260805 22:58:23.756088 12750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:23.757187 12750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:23.758397 12750 hybrid_clock.cc:648] HybridClock initialized: now 1785970703758352 us; error 39 us; skew 500 ppm
I20260805 22:58:23.758808 12750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:23 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970703, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:23.766050 12750 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:58:23.767809 12750 webserver.cc:460] Webserver started at http://127.20.34.65:34083/ using document root <none> and password file <none>
I20260805 22:58:23.768651 12750 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:23.768796 12750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:23.774636 12750 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20260805 22:58:23.777539 12822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:23.778963 12750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:58:23.779140 12750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "81b9cf0f757b439089e583aed8a54918"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "f952fc1c854c285bd5c313cd366c2800"
server_key_iv: "5d3f22c93292bd1a0abc14a81575ac68"
server_key_version: "encryptionkey@0"
I20260805 22:58:23.780165 12750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:23.794051 12750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:23.798349 12750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:23.798669 12750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:23.799714 12750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:23.801707 12833 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260805 22:58:23.807197 12833 ts_tablet_manager.cc:1852] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260805 22:58:23.808297 12833 ts_tablet_manager.cc:1905] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:23.815836 12833 ts_tablet_manager.cc:1918] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:23.816147 12833 ts_tablet_manager.cc:1939] T ae7f2c9e867f42c3942915933957e0a7 P 81b9cf0f757b439089e583aed8a54918: Deleting consensus metadata
I20260805 22:58:23.816656 12750 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260805 22:58:23.816800 12750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20260805 22:58:23.816963 12750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:23.817060 12750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:23.855233 12750 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:40161
I20260805 22:58:23.855299 12988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:40161 every 8 connection(s)
I20260805 22:58:23.856882 12750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:58:23.859437 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 12750
I20260805 22:58:23.860126 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:44971
--local_ip_for_outbound_sockets=127.20.34.66
--tserver_master_addrs=127.20.34.126:39757
--webserver_port=33407
--webserver_interface=127.20.34.66
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:58:23.862737 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:23.860563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:34787)
0805 22:58:23.861480 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:23.861798 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":391,"threads_started":1}
W20260805 22:58:23.863375 12989 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:39757 (0 consecutive failures): Network error: Failed to ping master at 127.20.34.126:39757: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
I20260805 22:58:23.864393 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:23.864007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:56913)
0805 22:58:23.864216 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:23.864288 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260805 22:58:23.865408 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:23.864945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:57605)
0805 22:58:23.865121 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:23.865235 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 22:58:23.865685 12989 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:58:24.222769 12992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:24.223086 12992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:24.223181 12992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:24.230603 12992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:24.230760 12992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:24.230880 12992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:58:24.241106 12992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:44971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=33407
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:24.242491 12992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:24.243844 12992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:24.257326 13000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:24.257623 12998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:24.257416 13002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:24.258476 12992 server_base.cc:1034] running on GCE node
I20260805 22:58:24.259065 12992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:24.260100 12992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:24.261360 12992 hybrid_clock.cc:648] HybridClock initialized: now 1785970704261315 us; error 35 us; skew 500 ppm
I20260805 22:58:24.261703 12992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:24 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970704, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:24.265058 12992 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:58:24.266819 12992 webserver.cc:460] Webserver started at http://127.20.34.66:33407/ using document root <none> and password file <none>
I20260805 22:58:24.267673 12992 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:24.267820 12992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:24.273954 12992 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260805 22:58:24.277025 13013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:24.278508 12992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:58:24.278708 12992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "16e7ea2340bf4585b5c74ac295f18441"
format_stamp: "Formatted at 2026-08-05 22:57:37 on dist-test-slave-gmjp"
server_key: "2d996fc7e9b89e2b50e4143cbb15ba14"
server_key_iv: "9faacfac6a837cd9133efad25904255f"
server_key_version: "encryptionkey@0"
I20260805 22:58:24.279743 12992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:24.297572 12992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:24.302290 12992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:24.302624 12992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:24.303684 12992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:24.305229 12992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:24.305332 12992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:24.305415 12992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:24.305477 12992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:24.341917 12992 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:44971
I20260805 22:58:24.342034 13179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:44971 every 8 connection(s)
I20260805 22:58:24.343461 12992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:58:24.345197 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 12992
I20260805 22:58:24.345909 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:37101
--local_ip_for_outbound_sockets=127.20.34.67
--tserver_master_addrs=127.20.34.126:39757
--webserver_port=43025
--webserver_interface=127.20.34.67
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:58:24.349231 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:24.346829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:57633)
0805 22:58:24.347732 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:24.348035 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":317,"threads_started":1}
W20260805 22:58:24.350035 13180 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:39757 (0 consecutive failures): Network error: Failed to ping master at 127.20.34.126:39757: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
I20260805 22:58:24.351076 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:24.350601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:35065)
0805 22:58:24.350792 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:24.350897 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260805 22:58:24.352195 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:24.351711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:45417)
0805 22:58:24.351894 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:24.351997 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 22:58:24.352505 13180 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 22:58:24.729882 13183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:24.730166 13183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:24.730365 13183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:24.737937 13183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:24.738065 13183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:24.738235 13183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:58:24.748351 13183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:37101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=43025
--tserver_master_addrs=127.20.34.126:39757
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:24.749872 13183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:24.751257 13183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:24.765118 13189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:24.765069 13196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:24.765170 13193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:24.766533 13183 server_base.cc:1034] running on GCE node
I20260805 22:58:24.767197 13183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:24.768322 13183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:24.769544 13183 hybrid_clock.cc:648] HybridClock initialized: now 1785970704769476 us; error 68 us; skew 500 ppm
I20260805 22:58:24.769965 13183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:24 dist-test-slave-gmjp krb5kdc[11097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970704, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:24.773464 13183 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:58:24.775089 13183 webserver.cc:460] Webserver started at http://127.20.34.67:43025/ using document root <none> and password file <none>
I20260805 22:58:24.775835 13183 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:24.776026 13183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:24.781950 13183 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260805 22:58:24.785401 13204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:24.786969 13183 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 22:58:24.787143 13183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "60e5674814b54303977ced792259cbdf"
format_stamp: "Formatted at 2026-08-05 22:57:38 on dist-test-slave-gmjp"
server_key: "6deb5b363432d8c96dfdb8429e757ed0"
server_key_iv: "8f24c246ff76b279b07be2485c5a81f0"
server_key_version: "encryptionkey@0"
I20260805 22:58:24.788223 13183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:24.820096 13183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:24.824589 13183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:24.824834 13183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:24.825812 13183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:24.827173 13183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:24.827280 13183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:24.827365 13183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:24.827430 13183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:24.865213 13183 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:37101
I20260805 22:58:24.865268 13373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:37101 every 8 connection(s)
I20260805 22:58:24.867177 13183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:58:24.867238 13374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:24.866375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:39019)
0805 22:58:24.866919 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:24.867008 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":271,"threads_started":1}
I20260805 22:58:24.872110 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 13183
I20260805 22:58:24.872579 13377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:24.870562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:46431)
0805 22:58:24.871319 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:24.871573 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":308,"threads_started":1}
W20260805 22:58:24.873400 13375 heartbeater.cc:644] Failed to heartbeat to 127.20.34.126:39757 (0 consecutive failures): Network error: Failed to ping master at 127.20.34.126:39757: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
I20260805 22:58:24.874423 13377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:24.874035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:47713)
0805 22:58:24.874184 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:24.874284 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260805 22:58:24.875265 13377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:24.874929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:58117)
0805 22:58:24.875074 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:24.875160 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260805 22:58:24.875516 13375 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 22:58:25.354044 13379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:25.353136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:36781)
0805 22:58:25.353634 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:25.353744 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":264,"threads_started":1}
I20260805 22:58:25.869298 13380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:25.868441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:55985)
0805 22:58:25.869022 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:25.869109 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":321,"threads_started":1}
I20260805 22:58:25.877152 13382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:25.876129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:54823)
0805 22:58:25.876788 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:25.876899 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":309,"threads_started":1}
I20260805 22:58:26.355886 13384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:26.355060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:35073)
0805 22:58:26.355619 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:26.355710 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":278,"threads_started":1}
I20260805 22:58:26.871229 13385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:26.870403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:42739)
0805 22:58:26.870909 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:26.871016 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":243,"threads_started":1}
I20260805 22:58:26.878938 13386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:26.878171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:58925)
0805 22:58:26.878671 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:26.878762 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":254,"threads_started":1}
I20260805 22:58:27.357623 13388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:27.356878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:48089)
0805 22:58:27.357360 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:27.357446 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":252,"threads_started":1}
I20260805 22:58:27.872987 13389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:27.872228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:44729)
0805 22:58:27.872701 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:27.872791 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":246,"threads_started":1}
I20260805 22:58:27.880683 13390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:27.879906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:40311)
0805 22:58:27.880427 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:27.880510 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":297,"threads_started":1}
I20260805 22:58:28.359581 13391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:28.358742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:38075)
0805 22:58:28.359269 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:28.359362 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":260,"threads_started":1}
I20260805 22:58:28.874622 13392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:28.873908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:43025)
0805 22:58:28.874362 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:28.874458 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":226,"threads_started":1}
I20260805 22:58:28.882344 13393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:28.881601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:40285)
0805 22:58:28.882078 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:28.882164 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":232,"threads_started":1}
I20260805 22:58:29.361755 13394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:29.360992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:36373)
0805 22:58:29.361491 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:29.361579 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":245,"threads_started":1}
I20260805 22:58:29.876579 13396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:29.875622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:34875)
0805 22:58:29.876267 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:29.876368 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":318,"threads_started":1}
I20260805 22:58:29.884389 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:29.883449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:39829)
0805 22:58:29.883999 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:29.884100 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":268,"threads_started":1}
I20260805 22:58:30.363803 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:30.362841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:39335)
0805 22:58:30.363447 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:30.363559 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":304,"threads_started":1}
I20260805 22:58:30.878539 13400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:30.877618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:48487)
0805 22:58:30.878198 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:30.878305 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":244,"threads_started":1}
I20260805 22:58:30.886178 13401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:30.885425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:41511)
0805 22:58:30.885906 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:30.886006 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":231,"threads_started":1}
I20260805 22:58:31.365612 13403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:31.364743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:49421)
0805 22:58:31.365305 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:31.365389 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":278,"threads_started":1}
I20260805 22:58:31.880491 13404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:31.879514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:51007)
0805 22:58:31.880047 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:31.880134 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":280,"threads_started":1}
I20260805 22:58:31.888163 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:31.887198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:54841)
0805 22:58:31.887757 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:31.887859 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":241,"threads_started":1}
I20260805 22:58:32.367746 13406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:32.366692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:56035)
0805 22:58:32.367344 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:32.367484 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":318,"threads_started":1}
I20260805 22:58:32.882262 13407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:32.881456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:39891)
0805 22:58:32.882002 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:32.882088 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":290,"threads_started":1}
I20260805 22:58:32.890014 13410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:32.889183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:49649)
0805 22:58:32.889757 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:32.889842 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":337,"threads_started":1}
I20260805 22:58:33.369738 13411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:33.368899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:58013)
0805 22:58:33.369453 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:33.369545 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":265,"threads_started":1}
I20260805 22:58:33.884377 13412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:33.883308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:44187)
0805 22:58:33.884025 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:33.884108 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":395,"threads_started":1}
I20260805 22:58:33.891978 13414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:33.891009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:59779)
0805 22:58:33.891669 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:33.891798 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":378,"threads_started":1}
I20260805 22:58:34.371771 13415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:34.370915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:55087)
0805 22:58:34.371460 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:34.371553 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":280,"threads_started":1}
I20260805 22:58:34.886394 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:34.885548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:58977)
0805 22:58:34.886089 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:34.886197 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":307,"threads_started":1}
I20260805 22:58:34.893726 13417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:34.892953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:55409)
0805 22:58:34.893461 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:34.893550 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":278,"threads_started":1}
I20260805 22:58:35.373781 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:35.372879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:60637)
0805 22:58:35.373497 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:35.373595 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":301,"threads_started":1}
I20260805 22:58:35.888140 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:35.887362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:50955)
0805 22:58:35.887845 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:35.887940 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":245,"threads_started":1}
I20260805 22:58:35.895709 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:35.894805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:32791)
0805 22:58:35.895401 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:35.895508 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":329,"threads_started":1}
I20260805 22:58:36.375743 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:36.374917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:33727)
0805 22:58:36.375403 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:36.375538 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":239,"threads_started":1}
I20260805 22:58:36.889983 13422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:36.889184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:51443)
0805 22:58:36.889673 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:36.889789 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":247,"threads_started":1}
I20260805 22:58:36.897614 13423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:36.896810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:60039)
0805 22:58:36.897329 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:36.897442 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":255,"threads_started":1}
I20260805 22:58:37.377848 13425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:37.376970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:40377)
0805 22:58:37.377523 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:37.377630 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":265,"threads_started":1}
I20260805 22:58:37.891898 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:37.890957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:52093)
0805 22:58:37.891502 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:37.891653 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":268,"threads_started":1}
I20260805 22:58:37.899423 13427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:37.898576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:37645)
0805 22:58:37.899082 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:37.899215 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":256,"threads_started":1}
I20260805 22:58:38.379989 13428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:38.379069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:48649)
0805 22:58:38.379662 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:38.379790 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":309,"threads_started":1}
I20260805 22:58:38.894061 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:38.893230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:37449)
0805 22:58:38.893761 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:38.893890 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":256,"threads_started":1}
I20260805 22:58:38.901441 13430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:38.900502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:34483)
0805 22:58:38.901059 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:38.901159 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":283,"threads_started":1}
I20260805 22:58:39.382332 13431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:39.381476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:52189)
0805 22:58:39.382016 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:39.382118 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":284,"threads_started":1}
I20260805 22:58:39.885687 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 12750
I20260805 22:58:39.896010 13433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:39.895143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.65:59621)
0805 22:58:39.895689 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:39.895814 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":263,"threads_started":1}
I20260805 22:58:39.903347 13435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:39.902591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.67:43513)
0805 22:58:39.903045 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:39.903140 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":222,"threads_started":1}
I20260805 22:58:40.384428 13436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:40.383450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:39757 (local address 127.20.34.66:51139)
0805 22:58:40.384047 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:40.384137 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.126:39757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":330,"threads_started":1}
I20260805 22:58:40.388243 13432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:39.887000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39718 (local address 127.20.34.65:40161)
0805 22:58:39.887828 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:39.887852 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:40.369116 (+481264us) server_negotiation.cc:407] Connection header received
0805 22:58:40.371262 (+ 2146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:40.371274 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:40.371868 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:40.372317 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:40.374151 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:40.375503 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:40.377005 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:40.377711 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:40.377958 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:40.381004 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:40.381012 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:40.381029 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:40.381072 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:40.384367 (+ 3295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:40.385278 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:40.385288 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:40.385298 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:40.385492 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:40.385989 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:40.385993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:40.385995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:40.386639 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:40.386916 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:40.387369 (+ 453us) server_negotiation.cc:299] Negotiation successful
0805 22:58:40.387859 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":435,"threads_started":1}
I20260805 22:58:40.390061 12982 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:40.481102 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 12750
I20260805 22:58:40.510337 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 12992
I20260805 22:58:40.530311 13438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:40.511706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55172 (local address 127.20.34.66:44971)
0805 22:58:40.512501 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:40.512517 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:40.512564 (+ 47us) server_negotiation.cc:407] Connection header received
0805 22:58:40.514307 (+ 1743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:40.514317 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:40.514770 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:40.515078 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:40.516965 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:40.518251 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:40.519614 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:40.520492 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:40.520648 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:40.523597 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:40.523605 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:40.523624 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:40.523669 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:40.527010 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:40.527748 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:40.527755 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:40.527763 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:40.527934 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:40.528423 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:40.528426 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:40.528428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:40.528992 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:40.529221 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:40.529630 (+ 409us) server_negotiation.cc:299] Negotiation successful
0805 22:58:40.529990 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":358,"threads_started":1}
I20260805 22:58:40.531832 13174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:40.618413 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 12992
I20260805 22:58:40.649910 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 13183
I20260805 22:58:40.670022 13442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:40.651127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42176 (local address 127.20.34.67:37101)
0805 22:58:40.651702 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:40.651716 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:40.651756 (+ 40us) server_negotiation.cc:407] Connection header received
0805 22:58:40.653509 (+ 1753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:40.653521 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:40.654010 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:40.654429 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:40.656257 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:40.657621 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:40.659100 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:40.659829 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:40.660061 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:40.663100 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:40.663109 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:40.663127 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:40.663168 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:40.666245 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:40.667007 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:40.667016 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:40.667023 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:40.667223 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:40.667657 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:40.667662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:40.667667 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:40.668348 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:40.668687 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:40.669207 (+ 520us) server_negotiation.cc:299] Negotiation successful
0805 22:58:40.669710 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":275,"threads_started":1}
I20260805 22:58:40.671646 13368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:40.759795 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 13183
2026-08-05T22:58:40Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (66109 ms)
[----------] 30 tests from SecurityITest (321100 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:58:40 dist-test-slave-gmjp krb5kdc[13451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:58:40 dist-test-slave-gmjp krb5kdc[13451](info): set up 2 sockets
Aug 05 22:58:40 dist-test-slave-gmjp krb5kdc[13451](info): commencing operation
krb5kdc: starting...
W20260805 22:58:42.118772 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.001s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:58:42 dist-test-slave-gmjp krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:58:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:58:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:58:42.481106 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43549
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:38669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:43549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:58:42.850783 13469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:42.851110 13469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:42.851293 13469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:42.858731 13469 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:58:42.858858 13469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:42.858951 13469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:42.859042 13469 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:58:42.859127 13469 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:58:42.869474 13469 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:43549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:42.871003 13469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:42.872431 13469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:42.885236 13476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:42.885299 13469 server_base.cc:1034] running on GCE node
W20260805 22:58:42.885200 13477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:42.885162 13480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:42.886571 13469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:42.888036 13469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:42.889246 13469 hybrid_clock.cc:648] HybridClock initialized: now 1785970722889196 us; error 31 us; skew 500 ppm
I20260805 22:58:42.889645 13469 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:42 dist-test-slave-gmjp krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970722, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:42.893101 13469 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:58:42.894734 13469 webserver.cc:460] Webserver started at http://127.20.34.126:40063/ using document root <none> and password file <none>
I20260805 22:58:42.895478 13469 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:42.895612 13469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:42.895947 13469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:42.899214 13469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "8476b7ced422493db2c31727786f0429"
format_stamp: "Formatted at 2026-08-05 22:58:42 on dist-test-slave-gmjp"
server_key: "ce38790ef03d718931c8475d5efe578a"
server_key_iv: "4abee7bd7c654d56cc493da7e4c1e413"
server_key_version: "encryptionkey@0"
I20260805 22:58:42.900074 13469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "8476b7ced422493db2c31727786f0429"
format_stamp: "Formatted at 2026-08-05 22:58:42 on dist-test-slave-gmjp"
server_key: "ce38790ef03d718931c8475d5efe578a"
server_key_iv: "4abee7bd7c654d56cc493da7e4c1e413"
server_key_version: "encryptionkey@0"
I20260805 22:58:42.905716 13469 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260805 22:58:42.909554 13491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:42.911070 13469 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:58:42.911293 13469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "8476b7ced422493db2c31727786f0429"
format_stamp: "Formatted at 2026-08-05 22:58:42 on dist-test-slave-gmjp"
server_key: "ce38790ef03d718931c8475d5efe578a"
server_key_iv: "4abee7bd7c654d56cc493da7e4c1e413"
server_key_version: "encryptionkey@0"
I20260805 22:58:42.911550 13469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:42.938294 13469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:42.942976 13469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:42.943310 13469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:42.963732 13469 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:43549
I20260805 22:58:42.963789 13557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:43549 every 8 connection(s)
I20260805 22:58:42.965173 13469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:58:42.967952 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 13469
I20260805 22:58:42.968274 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:58:42.969266 20617 external_mini_cluster.cc:1428] Setting key e4125324da175ba31be26d7774d47da0
I20260805 22:58:42.970072 13559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:42.986757 13559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429: Bootstrap starting.
Aug 05 22:58:42 dist-test-slave-gmjp krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:42.990995 13559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:42.992314 13559 log.cc:824] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:42.995639 13559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429: No bootstrap required, opened a new log
I20260805 22:58:42.996970 13564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:42.971769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51216 (local address 127.20.34.126:43549)
0805 22:58:42.972650 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:42.972662 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:42.972705 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:58:42.975022 (+ 2317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:42.975049 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:42.975499 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:42.975873 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:42.978423 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:42.979852 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:42.982084 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:42.982894 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:42.983047 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:42.988953 (+ 5906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:42.988962 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:42.988979 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:42.989025 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:42.992530 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:42.993344 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:42.993352 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:42.993360 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:42.993532 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:42.994008 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:42.994017 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:42.994019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:42.994577 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:42.994899 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:42.995408 (+ 509us) server_negotiation.cc:299] Negotiation successful
0805 22:58:42.995875 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":408,"threads_started":1}
I20260805 22:58:43.005059 13559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476b7ced422493db2c31727786f0429" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43549 } }
I20260805 22:58:43.005560 13559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:43.005700 13559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8476b7ced422493db2c31727786f0429, State: Initialized, Role: FOLLOWER
I20260805 22:58:43.006446 13559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476b7ced422493db2c31727786f0429" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43549 } }
I20260805 22:58:43.006747 13559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:58:43.006918 13559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:58:43.007125 13559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:43.009765 13559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476b7ced422493db2c31727786f0429" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43549 } }
I20260805 22:58:43.010403 13559 leader_election.cc:302] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8476b7ced422493db2c31727786f0429; no voters:
I20260805 22:58:43.011076 13559 leader_election.cc:288] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:58:43.011231 13567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:43.012055 13567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [term 1 LEADER]: Becoming Leader. State: Replica: 8476b7ced422493db2c31727786f0429, State: Running, Role: LEADER
I20260805 22:58:43.012760 13567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476b7ced422493db2c31727786f0429" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43549 } }
I20260805 22:58:43.013692 13559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:58:43.016431 13569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8476b7ced422493db2c31727786f0429. Latest consensus state: current_term: 1 leader_uuid: "8476b7ced422493db2c31727786f0429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476b7ced422493db2c31727786f0429" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43549 } } }
I20260805 22:58:43.017045 13569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:43.017401 13568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8476b7ced422493db2c31727786f0429" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8476b7ced422493db2c31727786f0429" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43549 } } }
I20260805 22:58:43.017817 13568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:43.019302 13578 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:58:43.024881 13578 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:58:43.034971 13578 catalog_manager.cc:1347] Generated new cluster ID: 6112a98341be4273a165c86e26425d84
I20260805 22:58:43.035125 13578 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:58:43.064826 13578 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:58:43.066337 13578 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:58:43.080480 13578 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429: Generated new TSK 0
I20260805 22:58:43.081693 13578 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:58:43.170250 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43549
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:38669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:58:43.566869 13600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:43.567255 13600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:43.567452 13600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:43.575562 13600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:43.575794 13600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:43.576001 13600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:58:43.587100 13600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:43.588590 13600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:43.590073 13600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:43.603866 13607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:43.603921 13613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:43.603896 13608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:43.605085 13600 server_base.cc:1034] running on GCE node
I20260805 22:58:43.605770 13600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:43.606793 13600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:43.608047 13600 hybrid_clock.cc:648] HybridClock initialized: now 1785970723608005 us; error 46 us; skew 500 ppm
I20260805 22:58:43.608422 13600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:43 dist-test-slave-gmjp krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970723, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:43.616441 13600 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:58:43.618389 13600 webserver.cc:460] Webserver started at http://127.20.34.65:42569/ using document root <none> and password file <none>
I20260805 22:58:43.619143 13600 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:43.619249 13600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:43.619518 13600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:43.622575 13600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "1fe8b2caa0de447bbdae900ac0bdcba7"
format_stamp: "Formatted at 2026-08-05 22:58:43 on dist-test-slave-gmjp"
server_key: "1ec6e2cf96ee2c8b041b65ac297b752f"
server_key_iv: "72340b56af52a2d56b5129b074a1d569"
server_key_version: "encryptionkey@0"
I20260805 22:58:43.623359 13600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "1fe8b2caa0de447bbdae900ac0bdcba7"
format_stamp: "Formatted at 2026-08-05 22:58:43 on dist-test-slave-gmjp"
server_key: "1ec6e2cf96ee2c8b041b65ac297b752f"
server_key_iv: "72340b56af52a2d56b5129b074a1d569"
server_key_version: "encryptionkey@0"
I20260805 22:58:43.629105 13600 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260805 22:58:43.632855 13622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:43.634431 13600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:58:43.634575 13600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "1fe8b2caa0de447bbdae900ac0bdcba7"
format_stamp: "Formatted at 2026-08-05 22:58:43 on dist-test-slave-gmjp"
server_key: "1ec6e2cf96ee2c8b041b65ac297b752f"
server_key_iv: "72340b56af52a2d56b5129b074a1d569"
server_key_version: "encryptionkey@0"
I20260805 22:58:43.634761 13600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:43.651170 13600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:43.655607 13600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:43.655859 13600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:43.656833 13600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:43.658236 13600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:43.658321 13600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:43.658407 13600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:43.658480 13600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:43.693529 13600 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:46757
I20260805 22:58:43.693574 13793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:46757 every 8 connection(s)
I20260805 22:58:43.694887 13600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:58:43.698448 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 13600
I20260805 22:58:43.698700 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:58:43.699710 20617 external_mini_cluster.cc:1428] Setting key 34ecc8e5bcc406a12e314f8603515f05
Aug 05 22:58:43 dist-test-slave-gmjp krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970723, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:43.720144 13796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:43.697615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:35069 (local address 127.20.34.126:43549)
0805 22:58:43.698114 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:43.698121 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:43.699414 (+ 1293us) server_negotiation.cc:407] Connection header received
0805 22:58:43.701744 (+ 2330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:43.701750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:43.701841 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:43.701954 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:43.704440 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:43.705183 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:43.707682 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:43.708113 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:43.708281 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:43.712787 (+ 4506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:43.712796 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:43.712803 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:43.712849 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:43.716651 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:43.717537 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:43.717543 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:43.717546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:43.717745 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:43.718238 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:43.718244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:43.718247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:43.718566 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:43.718726 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:43.719490 (+ 764us) server_negotiation.cc:299] Negotiation successful
0805 22:58:43.719743 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":234,"threads_started":1}
I20260805 22:58:43.721367 13797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:43.698248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43549 (local address 127.20.34.65:35069)
0805 22:58:43.699192 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:43.699259 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:43.701292 (+ 2033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:43.702252 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:43.702264 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:43.703088 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:43.703942 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:43.703971 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:43.705375 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:43.705383 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:43.707518 (+ 2135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:43.707536 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:43.708414 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:43.708423 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:43.708756 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:43.709502 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:43.709536 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:43.712544 (+ 3008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:43.716791 (+ 4247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:43.716799 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:43.716815 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:43.717398 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:43.717901 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:43.717908 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:43.717916 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:43.718113 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:43.718715 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:43.718723 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:43.719094 (+ 371us) client_negotiation.cc:769] Sending connection context
0805 22:58:43.719382 (+ 288us) client_negotiation.cc:240] Negotiation successful
0805 22:58:43.719996 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":409,"threads_started":1}
I20260805 22:58:43.723243 13794 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43549
I20260805 22:58:43.723592 13794 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:43.724462 13794 heartbeater.cc:511] Master 127.20.34.126:43549 requested a full tablet report, sending...
I20260805 22:58:43.726702 13511 ts_manager.cc:194] Registered new tserver with Master: 1fe8b2caa0de447bbdae900ac0bdcba7 (127.20.34.65:46757)
I20260805 22:58:43.728284 13511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:35069
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:58:43.777953 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43549
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:38669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:58:44.151686 13800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:44.152019 13800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:44.152114 13800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:44.159646 13800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:44.159803 13800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:44.159988 13800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:58:44.170712 13800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:44.172423 13800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:44.173930 13800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:44.187734 13806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:44.187840 13809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:44.187796 13807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:44.189244 13800 server_base.cc:1034] running on GCE node
I20260805 22:58:44.190141 13800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:44.191278 13800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:44.192538 13800 hybrid_clock.cc:648] HybridClock initialized: now 1785970724192498 us; error 57 us; skew 500 ppm
I20260805 22:58:44.192925 13800 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:44 dist-test-slave-gmjp krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970724, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:44.196381 13800 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:58:44.198160 13800 webserver.cc:460] Webserver started at http://127.20.34.66:34471/ using document root <none> and password file <none>
I20260805 22:58:44.198935 13800 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:44.199090 13800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:44.199431 13800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:44.202582 13800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "250d965fed664ba1a6c62295db3271b6"
format_stamp: "Formatted at 2026-08-05 22:58:44 on dist-test-slave-gmjp"
server_key: "fa2907c6c928accead6c9b87bc141777"
server_key_iv: "8ed4a6959fcbc698268051bea15c6a69"
server_key_version: "encryptionkey@0"
I20260805 22:58:44.203430 13800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "250d965fed664ba1a6c62295db3271b6"
format_stamp: "Formatted at 2026-08-05 22:58:44 on dist-test-slave-gmjp"
server_key: "fa2907c6c928accead6c9b87bc141777"
server_key_iv: "8ed4a6959fcbc698268051bea15c6a69"
server_key_version: "encryptionkey@0"
I20260805 22:58:44.209192 13800 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:58:44.213034 13818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:44.214712 13800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260805 22:58:44.214918 13800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "250d965fed664ba1a6c62295db3271b6"
format_stamp: "Formatted at 2026-08-05 22:58:44 on dist-test-slave-gmjp"
server_key: "fa2907c6c928accead6c9b87bc141777"
server_key_iv: "8ed4a6959fcbc698268051bea15c6a69"
server_key_version: "encryptionkey@0"
I20260805 22:58:44.215180 13800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:44.247364 13800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:44.252228 13800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:44.252562 13800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:44.253904 13800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:44.256493 13800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:44.256613 13800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:44.256780 13800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:44.256867 13800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:44.293432 13800 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:46145
I20260805 22:58:44.293481 13973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:46145 every 8 connection(s)
I20260805 22:58:44.294872 13800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:58:44.295385 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 13800
I20260805 22:58:44.295637 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:58:44.296351 20617 external_mini_cluster.cc:1428] Setting key d0032dece30286e48746b1ad963e3d5d
Aug 05 22:58:44 dist-test-slave-gmjp krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970724, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:44.318527 13976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.298090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:42449 (local address 127.20.34.126:43549)
0805 22:58:44.298654 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:44.298661 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:44.299783 (+ 1122us) server_negotiation.cc:407] Connection header received
0805 22:58:44.301848 (+ 2065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:44.301854 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:44.301952 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:44.302078 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:44.303716 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.304566 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.306265 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.306722 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.306870 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.311103 (+ 4233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:44.311109 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:44.311112 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:44.311150 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:44.314259 (+ 3109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:44.315299 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:44.315304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:44.315306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:44.315474 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:44.316249 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:44.316256 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:44.316259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:44.316668 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:44.316874 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:44.317920 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0805 22:58:44.318203 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":309,"threads_started":1}
I20260805 22:58:44.320212 13977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.298788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43549 (local address 127.20.34.66:42449)
0805 22:58:44.299609 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:44.299657 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:44.301532 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:44.302345 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:44.302354 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:44.302925 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:44.303523 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.303541 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.304753 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.304757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.306090 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.306103 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.306982 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.306989 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.307248 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.308014 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:44.308040 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:44.310791 (+ 2751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:44.314450 (+ 3659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:44.314459 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:44.314475 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:44.315145 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:44.315610 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:44.315619 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:44.315625 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:44.315953 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:44.316839 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:44.316851 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:44.317403 (+ 552us) client_negotiation.cc:769] Sending connection context
0805 22:58:44.317780 (+ 377us) client_negotiation.cc:240] Negotiation successful
0805 22:58:44.318506 (+ 726us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":361,"threads_started":1}
I20260805 22:58:44.322021 13974 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43549
I20260805 22:58:44.322386 13974 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:44.323242 13974 heartbeater.cc:511] Master 127.20.34.126:43549 requested a full tablet report, sending...
I20260805 22:58:44.325040 13511 ts_manager.cc:194] Registered new tserver with Master: 250d965fed664ba1a6c62295db3271b6 (127.20.34.66:46145)
I20260805 22:58:44.325989 13511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:42449
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:58:44.377120 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43549
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:38669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:58:44.731422 13794 heartbeater.cc:503] Master 127.20.34.126:43549 was elected leader, sending a full tablet report...
W20260805 22:58:44.756122 13980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:44.756485 13980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:44.756670 13980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:44.764209 13980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:44.764329 13980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:44.764540 13980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:58:44.775374 13980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:43549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:44.776955 13980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:44.778335 13980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:44.792766 13986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:44.792829 13990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:44.792743 13987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:44.793916 13980 server_base.cc:1034] running on GCE node
I20260805 22:58:44.794603 13980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:44.795619 13980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:44.796834 13980 hybrid_clock.cc:648] HybridClock initialized: now 1785970724796770 us; error 57 us; skew 500 ppm
I20260805 22:58:44.797201 13980 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:44 dist-test-slave-gmjp krb5kdc[13451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970724, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:44.800734 13980 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:58:44.802280 13980 webserver.cc:460] Webserver started at http://127.20.34.67:42891/ using document root <none> and password file <none>
I20260805 22:58:44.802994 13980 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:44.803110 13980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:44.803414 13980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:44.806746 13980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "7bf840ef903a4ef995934e088bf4d38d"
format_stamp: "Formatted at 2026-08-05 22:58:44 on dist-test-slave-gmjp"
server_key: "461ce18fd915f97007b928efc078a70b"
server_key_iv: "36e499818f2ca64fa25b9c0433dece91"
server_key_version: "encryptionkey@0"
I20260805 22:58:44.807586 13980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "7bf840ef903a4ef995934e088bf4d38d"
format_stamp: "Formatted at 2026-08-05 22:58:44 on dist-test-slave-gmjp"
server_key: "461ce18fd915f97007b928efc078a70b"
server_key_iv: "36e499818f2ca64fa25b9c0433dece91"
server_key_version: "encryptionkey@0"
I20260805 22:58:44.813515 13980 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260805 22:58:44.817693 13999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:44.819372 13980 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:58:44.819556 13980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "7bf840ef903a4ef995934e088bf4d38d"
format_stamp: "Formatted at 2026-08-05 22:58:44 on dist-test-slave-gmjp"
server_key: "461ce18fd915f97007b928efc078a70b"
server_key_iv: "36e499818f2ca64fa25b9c0433dece91"
server_key_version: "encryptionkey@0"
I20260805 22:58:44.819864 13980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:44.837472 13980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:44.842473 13980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:44.842805 13980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:44.843864 13980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:44.845395 13980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:44.845520 13980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:44.845691 13980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:44.845773 13980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:44.881341 13980 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:34617
I20260805 22:58:44.881386 14165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:34617 every 8 connection(s)
I20260805 22:58:44.882748 13980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:58:44.885136 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 13980
I20260805 22:58:44.885365 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:58:44.885998 20617 external_mini_cluster.cc:1428] Setting key 6c36cba5f33fd35a2d9302c5ea528d21
Aug 05 22:58:44 dist-test-slave-gmjp krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970724, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:44.904886 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.885474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:40125 (local address 127.20.34.126:43549)
0805 22:58:44.886011 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:44.886018 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:44.887277 (+ 1259us) server_negotiation.cc:407] Connection header received
0805 22:58:44.889789 (+ 2512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:44.889794 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:44.889891 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:44.889990 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:44.891584 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.892476 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.894035 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.894431 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.894527 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.898252 (+ 3725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:44.898257 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:44.898260 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:44.898297 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:44.901377 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:44.902424 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:44.902428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:44.902431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:44.902590 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:44.903111 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:44.903115 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:44.903117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:44.903418 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:44.903548 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:44.904409 (+ 861us) server_negotiation.cc:299] Negotiation successful
0805 22:58:44.904588 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":245,"threads_started":1}
I20260805 22:58:44.905900 14170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.886166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:43549 (local address 127.20.34.67:40125)
0805 22:58:44.887088 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:44.887140 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:44.889417 (+ 2277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:44.890224 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:44.890232 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:44.890797 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:44.891416 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.891434 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.892645 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.892649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.893901 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.893914 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.894626 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.894631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.894837 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.895560 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:44.895584 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:44.898037 (+ 2453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:44.901536 (+ 3499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:44.901544 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:44.901592 (+ 48us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:44.902304 (+ 712us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:44.902752 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:44.902756 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:44.902758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:44.902979 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:44.903575 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:44.903581 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:44.903967 (+ 386us) client_negotiation.cc:769] Sending connection context
0805 22:58:44.904314 (+ 347us) client_negotiation.cc:240] Negotiation successful
0805 22:58:44.904747 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":341,"threads_started":1}
I20260805 22:58:44.907279 14166 heartbeater.cc:347] Connected to a master server at 127.20.34.126:43549
I20260805 22:58:44.907620 14166 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:44.908469 14166 heartbeater.cc:511] Master 127.20.34.126:43549 requested a full tablet report, sending...
I20260805 22:58:44.910056 13511 ts_manager.cc:194] Registered new tserver with Master: 7bf840ef903a4ef995934e088bf4d38d (127.20.34.67:34617)
I20260805 22:58:44.910933 13511 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:40125
I20260805 22:58:44.915156 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:58:44.934100 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.920302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51226 (local address 127.20.34.126:43549)
0805 22:58:44.920481 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:44.920505 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:44.920958 (+ 453us) server_negotiation.cc:407] Connection header received
0805 22:58:44.921160 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:44.921166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:44.921277 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:44.921384 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:44.922946 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.923700 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.925267 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.925685 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.925851 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.928417 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:44.928423 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:44.928430 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:44.928469 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:44.931230 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:44.931946 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:44.931952 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:44.931962 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:44.932084 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:44.932519 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:44.932531 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:44.932533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:44.932885 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:44.933155 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:44.933519 (+ 364us) server_negotiation.cc:299] Negotiation successful
0805 22:58:44.933777 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260805 22:58:44.938939 13511 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51226:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:58:44.946776 13511 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:58:44.976502 14185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.960708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54328 (local address 127.20.34.65:46757)
0805 22:58:44.962056 (+ 1348us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:44.962070 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:44.963886 (+ 1816us) server_negotiation.cc:407] Connection header received
0805 22:58:44.964345 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:44.964359 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:44.964709 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:44.964917 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:44.966214 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.968448 (+ 2234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.973050 (+ 4602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.974705 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.974846 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.975109 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:44.975809 (+ 700us) server_negotiation.cc:299] Negotiation successful
0805 22:58:44.976002 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1112,"thread_start_us":885,"threads_started":1}
I20260805 22:58:44.977720 14189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.960726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:46757 (local address 127.0.0.1:54328)
0805 22:58:44.963742 (+ 3016us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:44.963765 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:44.964062 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:44.965360 (+ 1298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:44.965371 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:44.965414 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:44.965961 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.965978 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.968709 (+ 2731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.968717 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.972095 (+ 3378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.972126 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.975316 (+ 3190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.975323 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.975533 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.975583 (+ 50us) client_negotiation.cc:769] Sending connection context
0805 22:58:44.977079 (+ 1496us) client_negotiation.cc:240] Negotiation successful
0805 22:58:44.977325 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2850,"thread_start_us":2571,"threads_started":1}
I20260805 22:58:44.981472 14186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.960684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34617 (local address 127.0.0.1:40462)
0805 22:58:44.962644 (+ 1960us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:44.962692 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:44.962913 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:44.973606 (+ 10693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:44.973612 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:44.973639 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:44.974091 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.974105 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.976412 (+ 2307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.976418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.978747 (+ 2329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.978765 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.980686 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.980693 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.980884 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.980918 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:58:44.980989 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 22:58:44.981121 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1627,"thread_start_us":878,"threads_started":1}
I20260805 22:58:44.983049 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.961306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40462 (local address 127.20.34.67:34617)
0805 22:58:44.972885 (+ 11579us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:44.972895 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:44.972933 (+ 38us) server_negotiation.cc:407] Connection header received
0805 22:58:44.973044 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:44.973052 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:44.973356 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:44.974343 (+ 987us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:44.974631 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.976238 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.978948 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.980432 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.982160 (+ 1728us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.982427 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:44.982499 (+ 72us) server_negotiation.cc:299] Negotiation successful
0805 22:58:44.982670 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11381,"thread_start_us":11221,"threads_started":1}
I20260805 22:58:44.988095 14189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.963655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:46145 (local address 127.0.0.1:60868)
0805 22:58:44.978142 (+ 14487us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:44.978162 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:44.978268 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:44.979736 (+ 1468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:44.979743 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:44.979769 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:44.979983 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.979994 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.982167 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.982172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.984147 (+ 1975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:44.984184 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.987307 (+ 3123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.987314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:44.987502 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.987538 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 22:58:44.987624 (+ 86us) client_negotiation.cc:240] Negotiation successful
0805 22:58:44.987794 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14377,"threads_started":1}
I20260805 22:58:44.987632 14065 tablet_service.cc:1467] Processing CreateTablet for tablet bcba9d8b0ed84a569821bc7de658a3b0 (DEFAULT_TABLE table=test-table [id=11b5fd01f44443a990a2eaf12cf2c746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:44.989267 14191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:44.964345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60868 (local address 127.20.34.66:46145)
0805 22:58:44.979085 (+ 14740us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:44.979095 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:44.979125 (+ 30us) server_negotiation.cc:407] Connection header received
0805 22:58:44.979229 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:44.979238 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:44.979505 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:44.980180 (+ 675us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:44.980423 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.981981 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.984730 (+ 2749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:44.987061 (+ 2331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:44.988373 (+ 1312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:44.988607 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:44.988704 (+ 97us) server_negotiation.cc:299] Negotiation successful
0805 22:58:44.988917 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14567,"thread_start_us":14434,"threads_started":1}
I20260805 22:58:44.989835 14065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcba9d8b0ed84a569821bc7de658a3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:44.994704 13885 tablet_service.cc:1467] Processing CreateTablet for tablet bcba9d8b0ed84a569821bc7de658a3b0 (DEFAULT_TABLE table=test-table [id=11b5fd01f44443a990a2eaf12cf2c746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:44.995277 13692 tablet_service.cc:1467] Processing CreateTablet for tablet bcba9d8b0ed84a569821bc7de658a3b0 (DEFAULT_TABLE table=test-table [id=11b5fd01f44443a990a2eaf12cf2c746]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:44.997125 13692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcba9d8b0ed84a569821bc7de658a3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:44.998677 13885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcba9d8b0ed84a569821bc7de658a3b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:45.005038 14197 tablet_bootstrap.cc:492] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Bootstrap starting.
I20260805 22:58:45.008970 14197 tablet_bootstrap.cc:654] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:45.010308 14197 log.cc:824] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:45.013947 14197 tablet_bootstrap.cc:492] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: No bootstrap required, opened a new log
I20260805 22:58:45.014266 14197 ts_tablet_manager.cc:1397] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260805 22:58:45.015457 14204 tablet_bootstrap.cc:492] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: Bootstrap starting.
I20260805 22:58:45.017544 14205 tablet_bootstrap.cc:492] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: Bootstrap starting.
I20260805 22:58:45.020479 14204 tablet_bootstrap.cc:654] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:45.021589 14205 tablet_bootstrap.cc:654] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:45.021936 14204 log.cc:824] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:45.022928 14205 log.cc:824] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:45.025784 14204 tablet_bootstrap.cc:492] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: No bootstrap required, opened a new log
I20260805 22:58:45.026115 14204 ts_tablet_manager.cc:1397] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260805 22:58:45.026233 14197 raft_consensus.cc:348] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.026757 14197 raft_consensus.cc:374] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:45.026943 14197 raft_consensus.cc:729] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf840ef903a4ef995934e088bf4d38d, State: Initialized, Role: FOLLOWER
I20260805 22:58:45.027640 14197 consensus_queue.cc:260] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.029116 14166 heartbeater.cc:503] Master 127.20.34.126:43549 was elected leader, sending a full tablet report...
I20260805 22:58:45.029727 14197 ts_tablet_manager.cc:1428] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Time spent starting tablet: real 0.015s user 0.009s sys 0.006s
I20260805 22:58:45.037019 14204 raft_consensus.cc:348] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.037667 14204 raft_consensus.cc:374] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:45.038175 14204 raft_consensus.cc:729] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fe8b2caa0de447bbdae900ac0bdcba7, State: Initialized, Role: FOLLOWER
I20260805 22:58:45.039165 14204 consensus_queue.cc:260] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.040319 14205 tablet_bootstrap.cc:492] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: No bootstrap required, opened a new log
I20260805 22:58:45.040686 14205 ts_tablet_manager.cc:1397] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.009s
I20260805 22:58:45.041170 14204 ts_tablet_manager.cc:1428] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260805 22:58:45.049957 14205 raft_consensus.cc:348] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.050364 14205 raft_consensus.cc:374] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:45.050447 14205 raft_consensus.cc:729] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 250d965fed664ba1a6c62295db3271b6, State: Initialized, Role: FOLLOWER
I20260805 22:58:45.051055 14205 consensus_queue.cc:260] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.052117 13974 heartbeater.cc:503] Master 127.20.34.126:43549 was elected leader, sending a full tablet report...
I20260805 22:58:45.052875 14205 ts_tablet_manager.cc:1428] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: Time spent starting tablet: real 0.012s user 0.007s sys 0.005s
I20260805 22:58:45.064116 14209 raft_consensus.cc:482] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:58:45.064533 14209 raft_consensus.cc:504] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.066296 14209 leader_election.cc:288] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fe8b2caa0de447bbdae900ac0bdcba7 (127.20.34.65:46757), 250d965fed664ba1a6c62295db3271b6 (127.20.34.66:46145)
I20260805 22:58:45.073175 14185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:45.066812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:49843 (local address 127.20.34.65:46757)
0805 22:58:45.067058 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:45.067067 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:45.067094 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:58:45.067373 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:45.067379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:45.067468 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:45.067558 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:45.068258 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.069250 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.071387 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.072335 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.072501 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:45.072583 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:45.072771 (+ 188us) server_negotiation.cc:299] Negotiation successful
0805 22:58:45.072911 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260805 22:58:45.073192 14170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:45.066768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:46757 (local address 127.20.34.67:49843)
0805 22:58:45.067010 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:45.067032 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:45.067171 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:45.067746 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:45.067752 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:45.067783 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:45.068036 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:45.068054 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.069384 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.069387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:45.071204 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:45.071220 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.072475 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.072479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:45.072611 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:45.072637 (+ 26us) client_negotiation.cc:769] Sending connection context
0805 22:58:45.072719 (+ 82us) client_negotiation.cc:240] Negotiation successful
0805 22:58:45.072836 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":26}
I20260805 22:58:45.074311 14191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:45.067479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:48029 (local address 127.20.34.66:46145)
0805 22:58:45.067725 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:45.067733 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:45.068432 (+ 699us) server_negotiation.cc:407] Connection header received
0805 22:58:45.068561 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:45.068567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:45.068644 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:45.068743 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:45.069272 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.070022 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.072086 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.073407 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.073558 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:45.073631 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:45.074026 (+ 395us) server_negotiation.cc:299] Negotiation successful
0805 22:58:45.074125 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 22:58:45.074319 13723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcba9d8b0ed84a569821bc7de658a3b0" candidate_uuid: "7bf840ef903a4ef995934e088bf4d38d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" is_pre_election: true
I20260805 22:58:45.074653 14213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:45.067210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:46145 (local address 127.20.34.67:48029)
0805 22:58:45.068320 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:45.068335 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:45.068440 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:45.068761 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:45.068799 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:45.068818 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:45.069113 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:45.069121 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.070183 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.070189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:45.071921 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:45.071933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.073647 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.073653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:45.073837 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:45.073886 (+ 49us) client_negotiation.cc:769] Sending connection context
0805 22:58:45.073993 (+ 107us) client_negotiation.cc:240] Negotiation successful
0805 22:58:45.074127 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":4,"thread_start_us":756,"threads_started":1}
I20260805 22:58:45.075017 13723 raft_consensus.cc:2454] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf840ef903a4ef995934e088bf4d38d in term 0.
I20260805 22:58:45.075683 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcba9d8b0ed84a569821bc7de658a3b0" candidate_uuid: "7bf840ef903a4ef995934e088bf4d38d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "250d965fed664ba1a6c62295db3271b6" is_pre_election: true
I20260805 22:58:45.075814 14003 leader_election.cc:302] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fe8b2caa0de447bbdae900ac0bdcba7, 7bf840ef903a4ef995934e088bf4d38d; no voters:
I20260805 22:58:45.076202 13908 raft_consensus.cc:2454] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf840ef903a4ef995934e088bf4d38d in term 0.
I20260805 22:58:45.076294 14209 raft_consensus.cc:2781] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:58:45.076473 14209 raft_consensus.cc:482] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:58:45.076592 14209 raft_consensus.cc:3037] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:45.078990 14209 raft_consensus.cc:504] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.079669 14209 leader_election.cc:288] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [CANDIDATE]: Term 1 election: Requested vote from peers 1fe8b2caa0de447bbdae900ac0bdcba7 (127.20.34.65:46757), 250d965fed664ba1a6c62295db3271b6 (127.20.34.66:46145)
I20260805 22:58:45.080096 13723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcba9d8b0ed84a569821bc7de658a3b0" candidate_uuid: "7bf840ef903a4ef995934e088bf4d38d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7"
I20260805 22:58:45.080258 13908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcba9d8b0ed84a569821bc7de658a3b0" candidate_uuid: "7bf840ef903a4ef995934e088bf4d38d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "250d965fed664ba1a6c62295db3271b6"
I20260805 22:58:45.080374 13723 raft_consensus.cc:3037] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:45.080494 13908 raft_consensus.cc:3037] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:45.082696 13723 raft_consensus.cc:2454] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf840ef903a4ef995934e088bf4d38d in term 1.
I20260805 22:58:45.082820 13908 raft_consensus.cc:2454] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf840ef903a4ef995934e088bf4d38d in term 1.
I20260805 22:58:45.083105 14003 leader_election.cc:302] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fe8b2caa0de447bbdae900ac0bdcba7, 7bf840ef903a4ef995934e088bf4d38d; no voters:
I20260805 22:58:45.083545 14209 raft_consensus.cc:2781] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:45.084026 14209 raft_consensus.cc:686] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 1 LEADER]: Becoming Leader. State: Replica: 7bf840ef903a4ef995934e088bf4d38d, State: Running, Role: LEADER
I20260805 22:58:45.084554 14209 consensus_queue.cc:237] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } }
I20260805 22:58:45.089248 13511 catalog_manager.cc:5495] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf840ef903a4ef995934e088bf4d38d (127.20.34.67). New cstate: current_term: 1 leader_uuid: "7bf840ef903a4ef995934e088bf4d38d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bf840ef903a4ef995934e088bf4d38d" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260805 22:58:45.134497 14167 tablet.cc:2369] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:58:45.135790 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:45.129786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40472 (local address 127.20.34.67:34617)
0805 22:58:45.130039 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:45.130044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:45.130066 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:58:45.130279 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:45.130283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:45.130365 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:45.130492 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:58:45.130904 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.131735 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.133164 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.133609 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.133711 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:45.134262 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:58:45.135060 (+ 798us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:58:45.135224 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:45.135344 (+ 120us) server_negotiation.cc:299] Negotiation successful
0805 22:58:45.135463 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260805 22:58:45.144466 13908 raft_consensus.cc:1261] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 1 FOLLOWER]: Refusing update from remote peer 7bf840ef903a4ef995934e088bf4d38d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:45.144474 13723 raft_consensus.cc:1261] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 1 FOLLOWER]: Refusing update from remote peer 7bf840ef903a4ef995934e088bf4d38d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:45.145424 14214 consensus_queue.cc:1035] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fe8b2caa0de447bbdae900ac0bdcba7" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:45.145820 14209 consensus_queue.cc:1035] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [LEADER]: Connected to new peer: Peer: permanent_uuid: "250d965fed664ba1a6c62295db3271b6" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:45.157546 14217 mvcc.cc:205] Tried to move back new op lower bound from 7315336090181476352 to 7315336089950097408. Current Snapshot: MvccSnapshot[applied={T|T < 7315336090181476352}]
I20260805 22:58:45.174372 13510 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:45.174639 13510 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:45.178444 13510 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8476b7ced422493db2c31727786f0429: Sending DeleteTablet for 3 replicas of tablet bcba9d8b0ed84a569821bc7de658a3b0
I20260805 22:58:45.179745 14065 tablet_service.cc:1514] Processing DeleteTablet for tablet bcba9d8b0ed84a569821bc7de658a3b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:45 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:40462
I20260805 22:58:45.179785 13885 tablet_service.cc:1514] Processing DeleteTablet for tablet bcba9d8b0ed84a569821bc7de658a3b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:45 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:60868
I20260805 22:58:45.179774 13692 tablet_service.cc:1514] Processing DeleteTablet for tablet bcba9d8b0ed84a569821bc7de658a3b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:45 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:54328
I20260805 22:58:45.196719 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 13600
I20260805 22:58:45.200193 14232 tablet_replica.cc:330] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: stopping tablet replica
I20260805 22:58:45.200861 14231 tablet_replica.cc:330] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: stopping tablet replica
I20260805 22:58:45.202039 14231 raft_consensus.cc:2229] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:45.202692 14232 raft_consensus.cc:2229] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:58:45.203516 14232 raft_consensus.cc:2258] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:45.204200 14231 raft_consensus.cc:2258] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:45.207157 14231 ts_tablet_manager.cc:1905] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:45.209365 14232 ts_tablet_manager.cc:1905] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:45.210040 14230 tablet_replica.cc:330] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: stopping tablet replica
I20260805 22:58:45.210570 14230 raft_consensus.cc:2229] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:45.211180 14230 raft_consensus.cc:2258] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:45.213447 14230 ts_tablet_manager.cc:1905] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:45.221374 14230 ts_tablet_manager.cc:1918] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:45.221683 14230 log.cc:1196] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/bcba9d8b0ed84a569821bc7de658a3b0
Aug 05 22:58:45 dist-test-slave-gmjp krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:58:45.222417 14230 ts_tablet_manager.cc:1939] T bcba9d8b0ed84a569821bc7de658a3b0 P 1fe8b2caa0de447bbdae900ac0bdcba7: Deleting consensus metadata
I20260805 22:58:45.224897 13496 catalog_manager.cc:4841] TS 1fe8b2caa0de447bbdae900ac0bdcba7 (127.20.34.65:46757): tablet bcba9d8b0ed84a569821bc7de658a3b0 (table test-table [id=11b5fd01f44443a990a2eaf12cf2c746]) successfully deleted
I20260805 22:58:45.227294 14231 ts_tablet_manager.cc:1918] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:45.227587 14231 log.cc:1196] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/bcba9d8b0ed84a569821bc7de658a3b0
I20260805 22:58:45.228353 14231 ts_tablet_manager.cc:1939] T bcba9d8b0ed84a569821bc7de658a3b0 P 250d965fed664ba1a6c62295db3271b6: Deleting consensus metadata
I20260805 22:58:45.228339 14232 ts_tablet_manager.cc:1918] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:45.228525 14232 log.cc:1196] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/bcba9d8b0ed84a569821bc7de658a3b0
I20260805 22:58:45.229208 14232 ts_tablet_manager.cc:1939] T bcba9d8b0ed84a569821bc7de658a3b0 P 7bf840ef903a4ef995934e088bf4d38d: Deleting consensus metadata
I20260805 22:58:45.230532 13496 catalog_manager.cc:4841] TS 250d965fed664ba1a6c62295db3271b6 (127.20.34.66:46145): tablet bcba9d8b0ed84a569821bc7de658a3b0 (table test-table [id=11b5fd01f44443a990a2eaf12cf2c746]) successfully deleted
I20260805 22:58:45.230800 14185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:45.198269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54336 (local address 127.20.34.65:46757)
0805 22:58:45.198500 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:45.198507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:45.209544 (+ 11037us) server_negotiation.cc:407] Connection header received
0805 22:58:45.210161 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:45.210167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:45.210270 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:45.210381 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:45.212578 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.213753 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.216023 (+ 2270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.216712 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.216814 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:45.223126 (+ 6312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:45.223147 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:45.223167 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:45.223218 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:45.226870 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:45.227880 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:45.227894 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:45.227911 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:45.228106 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:45.228681 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:45.228686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:45.228692 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:45.229207 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:45.229511 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:45.230149 (+ 638us) server_negotiation.cc:299] Negotiation successful
0805 22:58:45.230408 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:58:45.231019 13493 catalog_manager.cc:4841] TS 7bf840ef903a4ef995934e088bf4d38d (127.20.34.67:34617): tablet bcba9d8b0ed84a569821bc7de658a3b0 (table test-table [id=11b5fd01f44443a990a2eaf12cf2c746]) successfully deleted
I20260805 22:58:45.232372 13788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:45.373682 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 13600
I20260805 22:58:45.401567 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 13800
Aug 05 22:58:45 dist-test-slave-gmjp krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:58:45.420962 14191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:45.402533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60878 (local address 127.20.34.66:46145)
0805 22:58:45.402715 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:45.402719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:45.402738 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:58:45.402993 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:45.402998 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:45.403080 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:45.403166 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:45.405165 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.406003 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.408030 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.408536 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.408653 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:45.414386 (+ 5733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:45.414403 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:45.414420 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:45.414461 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:45.417735 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:45.418686 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:45.418693 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:45.418696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:45.418824 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:45.419288 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:45.419291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:45.419293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:45.419782 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:45.420087 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:45.420467 (+ 380us) server_negotiation.cc:299] Negotiation successful
0805 22:58:45.420639 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 22:58:45.421870 13968 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:45.517277 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 13800
I20260805 22:58:45.547884 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 13980
Aug 05 22:58:45 dist-test-slave-gmjp krb5kdc[13451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:58:45.568694 14187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:45.548987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40478 (local address 127.20.34.67:34617)
0805 22:58:45.549173 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:45.549178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:45.549197 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:58:45.549275 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:45.549279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:45.549361 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:45.549443 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:45.551355 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.552473 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.554547 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:45.555043 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:45.555159 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:45.561540 (+ 6381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:45.561558 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:45.561575 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:45.561627 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:45.565479 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:45.566408 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:45.566415 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:45.566418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:45.566570 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:45.567038 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:45.567041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:45.567046 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:45.567421 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:45.567661 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:45.568078 (+ 417us) server_negotiation.cc:299] Negotiation successful
0805 22:58:45.568330 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 22:58:45.569545 14161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:45.700663 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 13980
I20260805 22:58:45.730114 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 13469
I20260805 22:58:45.731528 13551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:45.845824 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 13469
2026-08-05T22:58:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5087 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-05T22:58:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:58:45Z Disabled control of system clock
I20260805 22:58:45.954640 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:38281
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:34109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:38281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:58:46.320956 14243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:46.321308 14243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:46.321435 14243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:46.329095 14243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:58:46.329212 14243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:46.329313 14243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:46.329423 14243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:58:46.329491 14243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:58:46.339218 14243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:38281
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:38281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:46.341081 14243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:46.343142 14243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:46.355897 14248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:46.355943 14250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:46.355832 14253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:46.361867 14243 server_base.cc:1034] running on GCE node
I20260805 22:58:46.362828 14243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:46.364495 14243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:46.365732 14243 hybrid_clock.cc:648] HybridClock initialized: now 1785970726365674 us; error 26 us; skew 500 ppm
I20260805 22:58:46.366119 14243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:58:46.368549 14243 webserver.cc:460] Webserver started at http://127.20.34.126:34681/ using document root <none> and password file <none>
I20260805 22:58:46.369278 14243 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:46.369400 14243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:46.369786 14243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:46.372876 14243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "b9295ca64c75474e9b6ec5d76a882335"
format_stamp: "Formatted at 2026-08-05 22:58:46 on dist-test-slave-gmjp"
server_key: "365ccda7d32c8f07d812b23445c41df7"
server_key_iv: "576549aa55d9e227d0ce056d5d6fbfbf"
server_key_version: "encryptionkey@0"
I20260805 22:58:46.373723 14243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "b9295ca64c75474e9b6ec5d76a882335"
format_stamp: "Formatted at 2026-08-05 22:58:46 on dist-test-slave-gmjp"
server_key: "365ccda7d32c8f07d812b23445c41df7"
server_key_iv: "576549aa55d9e227d0ce056d5d6fbfbf"
server_key_version: "encryptionkey@0"
I20260805 22:58:46.379272 14243 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:58:46.382962 14261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:46.384512 14243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 22:58:46.384737 14243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "b9295ca64c75474e9b6ec5d76a882335"
format_stamp: "Formatted at 2026-08-05 22:58:46 on dist-test-slave-gmjp"
server_key: "365ccda7d32c8f07d812b23445c41df7"
server_key_iv: "576549aa55d9e227d0ce056d5d6fbfbf"
server_key_version: "encryptionkey@0"
I20260805 22:58:46.384971 14243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:46.408231 14243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:46.409205 14243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:46.409540 14243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:46.429742 14243 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:38281
I20260805 22:58:46.429761 14335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:38281 every 8 connection(s)
I20260805 22:58:46.431216 14243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:58:46.435204 14336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:46.441255 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 14243
I20260805 22:58:46.441447 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:58:46.441977 20617 external_mini_cluster.cc:1428] Setting key 1c76e78df906a52df238981e6fee37dd
I20260805 22:58:46.447026 14336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335: Bootstrap starting.
I20260805 22:58:46.451402 14336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:46.452992 14336 log.cc:824] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:46.457155 14336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335: No bootstrap required, opened a new log
I20260805 22:58:46.461388 14342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:46.444116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55048 (local address 127.20.34.126:38281)
0805 22:58:46.445384 (+ 1268us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:46.445395 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:46.445438 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:58:46.447174 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:46.447208 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:46.447855 (+ 647us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:46.448330 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:46.449377 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:46.451341 (+ 1964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:46.453838 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:46.455122 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:46.455388 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:46.458081 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:46.458098 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:46.458124 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:46.458917 (+ 793us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:46.459027 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:46.459055 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:46.459184 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:46.459476 (+ 292us) server_negotiation.cc:299] Negotiation successful
0805 22:58:46.459910 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":458,"threads_started":1}
I20260805 22:58:46.467547 14336 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9295ca64c75474e9b6ec5d76a882335" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38281 } }
I20260805 22:58:46.468055 14336 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:46.468225 14336 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9295ca64c75474e9b6ec5d76a882335, State: Initialized, Role: FOLLOWER
I20260805 22:58:46.468938 14336 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9295ca64c75474e9b6ec5d76a882335" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38281 } }
I20260805 22:58:46.469221 14336 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:58:46.469367 14336 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:58:46.469556 14336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:46.471850 14336 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9295ca64c75474e9b6ec5d76a882335" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38281 } }
I20260805 22:58:46.472502 14336 leader_election.cc:302] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9295ca64c75474e9b6ec5d76a882335; no voters:
I20260805 22:58:46.473124 14336 leader_election.cc:288] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:58:46.473296 14346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:46.474071 14346 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [term 1 LEADER]: Becoming Leader. State: Replica: b9295ca64c75474e9b6ec5d76a882335, State: Running, Role: LEADER
I20260805 22:58:46.474643 14346 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9295ca64c75474e9b6ec5d76a882335" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38281 } }
I20260805 22:58:46.475449 14336 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:58:46.477666 14348 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9295ca64c75474e9b6ec5d76a882335. Latest consensus state: current_term: 1 leader_uuid: "b9295ca64c75474e9b6ec5d76a882335" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9295ca64c75474e9b6ec5d76a882335" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38281 } } }
I20260805 22:58:46.478031 14348 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:46.478514 14347 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9295ca64c75474e9b6ec5d76a882335" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9295ca64c75474e9b6ec5d76a882335" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 38281 } } }
I20260805 22:58:46.478861 14347 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:46.479920 14352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:58:46.485064 14352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:58:46.496382 14352 catalog_manager.cc:1347] Generated new cluster ID: 6c704bb4e846403d859a2914607e2332
I20260805 22:58:46.496520 14352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:58:46.518071 14352 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:58:46.520007 14352 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:58:46.542964 14352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335: Generated new TSK 0
I20260805 22:58:46.543963 14352 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:58:46.558938 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38281
--builtin_ntp_servers=127.20.34.84:34109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:58:46.931514 14367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:46.931876 14367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:46.932055 14367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:46.939514 14367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:46.939631 14367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:46.939810 14367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:58:46.949481 14367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:46.951104 14367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:46.953013 14367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:46.966321 14373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:46.966732 14374 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:46.967208 14377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:46.968247 14367 server_base.cc:1034] running on GCE node
I20260805 22:58:46.968950 14367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:46.970085 14367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:46.971366 14367 hybrid_clock.cc:648] HybridClock initialized: now 1785970726971289 us; error 42 us; skew 500 ppm
I20260805 22:58:46.971751 14367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:58:46.974413 14367 webserver.cc:460] Webserver started at http://127.20.34.65:37261/ using document root <none> and password file <none>
I20260805 22:58:46.975185 14367 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:46.975306 14367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:46.975656 14367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:46.978981 14367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "42fdf3ac55b74d6895e7873ba4c810a6"
format_stamp: "Formatted at 2026-08-05 22:58:46 on dist-test-slave-gmjp"
server_key: "3bf2db416952bdb538fb082d9e21663c"
server_key_iv: "e225ddedbfa7d3e00233ecda44bdee38"
server_key_version: "encryptionkey@0"
I20260805 22:58:46.979959 14367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "42fdf3ac55b74d6895e7873ba4c810a6"
format_stamp: "Formatted at 2026-08-05 22:58:46 on dist-test-slave-gmjp"
server_key: "3bf2db416952bdb538fb082d9e21663c"
server_key_iv: "e225ddedbfa7d3e00233ecda44bdee38"
server_key_version: "encryptionkey@0"
I20260805 22:58:46.985569 14367 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260805 22:58:46.989264 14389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:46.990790 14367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:58:46.991017 14367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "42fdf3ac55b74d6895e7873ba4c810a6"
format_stamp: "Formatted at 2026-08-05 22:58:46 on dist-test-slave-gmjp"
server_key: "3bf2db416952bdb538fb082d9e21663c"
server_key_iv: "e225ddedbfa7d3e00233ecda44bdee38"
server_key_version: "encryptionkey@0"
I20260805 22:58:46.991279 14367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:47.008450 14367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:47.009444 14367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:47.009793 14367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:47.010928 14367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:47.012682 14367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:47.012779 14367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:47.012915 14367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:47.013013 14367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:47.049254 14367 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:46507
I20260805 22:58:47.049350 14548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:46507 every 8 connection(s)
I20260805 22:58:47.050655 14367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:58:47.056712 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 14367
I20260805 22:58:47.056958 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:58:47.057474 20617 external_mini_cluster.cc:1428] Setting key 11d8f16b4378979f12d12207b40b4c16
I20260805 22:58:47.060866 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38281
--builtin_ntp_servers=127.20.34.84:34109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:58:47.065518 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:47.053465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:47139 (local address 127.20.34.126:38281)
0805 22:58:47.053977 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:47.053981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:47.055206 (+ 1225us) server_negotiation.cc:407] Connection header received
0805 22:58:47.057292 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:47.057299 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:47.057401 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:47.057528 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:47.058898 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:47.060050 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:47.061870 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:47.062710 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:47.062907 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:47.064439 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:47.064449 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:47.064458 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:47.064488 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:47.064548 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:47.064569 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:47.064679 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:47.064916 (+ 237us) server_negotiation.cc:299] Negotiation successful
0805 22:58:47.065042 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":271,"threads_started":1}
I20260805 22:58:47.066334 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:47.053969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:38281 (local address 127.20.34.65:47139)
0805 22:58:47.055022 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:47.055061 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:47.056959 (+ 1898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:47.057776 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:47.057784 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:47.057876 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:47.058701 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:47.058728 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:47.060276 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:47.060280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:47.061704 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:47.061718 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:47.062994 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:47.063000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:47.063214 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:47.064012 (+ 798us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:58:47.064014 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:47.064066 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:58:47.064201 (+ 135us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:47.064685 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:47.064694 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:47.064700 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:58:47.064867 (+ 167us) client_negotiation.cc:240] Negotiation successful
0805 22:58:47.065182 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":291,"threads_started":1}
I20260805 22:58:47.068190 14549 heartbeater.cc:347] Connected to a master server at 127.20.34.126:38281
I20260805 22:58:47.068584 14549 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:47.069701 14549 heartbeater.cc:511] Master 127.20.34.126:38281 requested a full tablet report, sending...
I20260805 22:58:47.072322 14285 ts_manager.cc:194] Registered new tserver with Master: 42fdf3ac55b74d6895e7873ba4c810a6 (127.20.34.65:46507)
I20260805 22:58:47.073836 14285 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.65:47139
W20260805 22:58:47.426718 14555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:47.427026 14555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:47.427193 14555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:47.438027 14555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:47.438161 14555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:47.438328 14555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:58:47.453343 14555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:47.454751 14555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:47.456627 14555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:47.470274 14564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:47.470331 14565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:47.470935 14568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:47.471586 14555 server_base.cc:1034] running on GCE node
I20260805 22:58:47.472384 14555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:47.473529 14555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:47.474793 14555 hybrid_clock.cc:648] HybridClock initialized: now 1785970727474712 us; error 45 us; skew 500 ppm
I20260805 22:58:47.475142 14555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:58:47.477754 14555 webserver.cc:460] Webserver started at http://127.20.34.66:41343/ using document root <none> and password file <none>
I20260805 22:58:47.478572 14555 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:47.478713 14555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:47.479050 14555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:47.482157 14555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "517066a0104741308f4a7796c1a5c9e1"
format_stamp: "Formatted at 2026-08-05 22:58:47 on dist-test-slave-gmjp"
server_key: "3b299366fb8ec8b6d9c3aa4c50c7d293"
server_key_iv: "0daa4906dbd9ed998b10baf4fb8f7e50"
server_key_version: "encryptionkey@0"
I20260805 22:58:47.483031 14555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "517066a0104741308f4a7796c1a5c9e1"
format_stamp: "Formatted at 2026-08-05 22:58:47 on dist-test-slave-gmjp"
server_key: "3b299366fb8ec8b6d9c3aa4c50c7d293"
server_key_iv: "0daa4906dbd9ed998b10baf4fb8f7e50"
server_key_version: "encryptionkey@0"
I20260805 22:58:47.488677 14555 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260805 22:58:47.492554 14577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:47.493960 14555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:58:47.494166 14555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "517066a0104741308f4a7796c1a5c9e1"
format_stamp: "Formatted at 2026-08-05 22:58:47 on dist-test-slave-gmjp"
server_key: "3b299366fb8ec8b6d9c3aa4c50c7d293"
server_key_iv: "0daa4906dbd9ed998b10baf4fb8f7e50"
server_key_version: "encryptionkey@0"
I20260805 22:58:47.494400 14555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:47.513540 14555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:47.514449 14555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:47.514793 14555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:47.515862 14555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:47.517447 14555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:47.517575 14555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:47.517711 14555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:47.517807 14555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:47.553442 14555 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:43291
I20260805 22:58:47.553495 14748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:43291 every 8 connection(s)
I20260805 22:58:47.554836 14555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:58:47.559588 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 14555
I20260805 22:58:47.559818 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:58:47.560343 20617 external_mini_cluster.cc:1428] Setting key 1103b94cd1a4e29cf3e980667aedf8b9
I20260805 22:58:47.563798 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38281
--builtin_ntp_servers=127.20.34.84:34109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:58:47.569298 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:47.557674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:56189 (local address 127.20.34.126:38281)
0805 22:58:47.557901 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:47.557907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:47.559395 (+ 1488us) server_negotiation.cc:407] Connection header received
0805 22:58:47.561621 (+ 2226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:47.561627 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:47.561718 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:47.561818 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:47.563173 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:47.564331 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:47.565907 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:47.566611 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:47.566754 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:47.568357 (+ 1603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:47.568365 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:47.568373 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:47.568401 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:47.568445 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:47.568464 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:47.568557 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:47.568762 (+ 205us) server_negotiation.cc:299] Negotiation successful
0805 22:58:47.568881 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 22:58:47.570222 14757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:47.558245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:38281 (local address 127.20.34.66:56189)
0805 22:58:47.559213 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:47.559266 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:47.561300 (+ 2034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:47.562105 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:47.562117 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:47.562238 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:47.562999 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:47.563018 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:47.564478 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:47.564482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:47.565752 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:47.565766 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:47.566867 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:47.566875 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:47.567206 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:47.567964 (+ 758us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:58:47.567966 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:47.568011 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:58:47.568112 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:47.568561 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:47.568570 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:47.568576 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:58:47.568720 (+ 144us) client_negotiation.cc:240] Negotiation successful
0805 22:58:47.569038 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":312,"threads_started":1}
I20260805 22:58:47.571959 14749 heartbeater.cc:347] Connected to a master server at 127.20.34.126:38281
I20260805 22:58:47.572371 14749 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:47.573227 14749 heartbeater.cc:511] Master 127.20.34.126:38281 requested a full tablet report, sending...
I20260805 22:58:47.574892 14285 ts_manager.cc:194] Registered new tserver with Master: 517066a0104741308f4a7796c1a5c9e1 (127.20.34.66:43291)
I20260805 22:58:47.575798 14285 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.66:56189
W20260805 22:58:47.922756 14758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:47.923048 14758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:47.923207 14758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:47.930570 14758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:47.930675 14758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:47.930855 14758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:58:47.940029 14758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:34109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:38281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:47.941512 14758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:47.943400 14758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:47.957475 14769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:47.957415 14768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:47.957490 14772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:47.960070 14758 server_base.cc:1034] running on GCE node
I20260805 22:58:47.960856 14758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:47.961939 14758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:47.963186 14758 hybrid_clock.cc:648] HybridClock initialized: now 1785970727963132 us; error 92 us; skew 500 ppm
I20260805 22:58:47.963546 14758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:58:47.966017 14758 webserver.cc:460] Webserver started at http://127.20.34.67:36735/ using document root <none> and password file <none>
I20260805 22:58:47.966744 14758 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:47.966883 14758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:47.967218 14758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:47.970240 14758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "a4646dd7951c4b35a5325c49b748d0e9"
format_stamp: "Formatted at 2026-08-05 22:58:47 on dist-test-slave-gmjp"
server_key: "865ab8bc7a30a0da453b8290ce573fc1"
server_key_iv: "342f1e213ad8fcb2a8d31dbd9374b6b8"
server_key_version: "encryptionkey@0"
I20260805 22:58:47.971061 14758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "a4646dd7951c4b35a5325c49b748d0e9"
format_stamp: "Formatted at 2026-08-05 22:58:47 on dist-test-slave-gmjp"
server_key: "865ab8bc7a30a0da453b8290ce573fc1"
server_key_iv: "342f1e213ad8fcb2a8d31dbd9374b6b8"
server_key_version: "encryptionkey@0"
I20260805 22:58:47.976796 14758 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260805 22:58:47.980561 14780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:47.981971 14758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:58:47.982149 14758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "a4646dd7951c4b35a5325c49b748d0e9"
format_stamp: "Formatted at 2026-08-05 22:58:47 on dist-test-slave-gmjp"
server_key: "865ab8bc7a30a0da453b8290ce573fc1"
server_key_iv: "342f1e213ad8fcb2a8d31dbd9374b6b8"
server_key_version: "encryptionkey@0"
I20260805 22:58:47.982388 14758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:48.006074 14758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:48.006994 14758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:48.007347 14758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:48.008438 14758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:48.010049 14758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:48.010176 14758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:48.010321 14758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:48.010416 14758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:48.047159 14758 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:37837
I20260805 22:58:48.047230 14956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:37837 every 8 connection(s)
I20260805 22:58:48.048532 14758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:58:48.052001 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 14758
I20260805 22:58:48.052232 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:58:48.057081 20617 external_mini_cluster.cc:1428] Setting key ac709296501a8af06f11a8bae47d15eb
I20260805 22:58:48.063522 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.051369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:43929 (local address 127.20.34.126:38281)
0805 22:58:48.051620 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.051628 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.053509 (+ 1881us) server_negotiation.cc:407] Connection header received
0805 22:58:48.056556 (+ 3047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.056562 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.056665 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.056791 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:48.058138 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.058996 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.060709 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.061098 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.061252 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.062610 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:48.062615 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:48.062619 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:48.062637 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:48.062667 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:48.062678 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:48.062805 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.063040 (+ 235us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.063141 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 22:58:48.064618 14959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.051943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:38281 (local address 127.20.34.67:43929)
0805 22:58:48.053284 (+ 1341us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:48.053338 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:48.056096 (+ 2758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:48.057130 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:48.057162 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:48.057303 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:48.057939 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.057960 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.059185 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.059190 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.060553 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.060566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.061338 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.061347 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.061603 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.062276 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:58:48.062279 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:48.062320 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:58:48.062404 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:48.062803 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:48.062818 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:48.062829 (+ 11us) client_negotiation.cc:769] Sending connection context
0805 22:58:48.063031 (+ 202us) client_negotiation.cc:240] Negotiation successful
0805 22:58:48.063447 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":433,"threads_started":1}
I20260805 22:58:48.066167 14957 heartbeater.cc:347] Connected to a master server at 127.20.34.126:38281
I20260805 22:58:48.066494 14957 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:48.067281 14957 heartbeater.cc:511] Master 127.20.34.126:38281 requested a full tablet report, sending...
I20260805 22:58:48.068838 14285 ts_manager.cc:194] Registered new tserver with Master: a4646dd7951c4b35a5325c49b748d0e9 (127.20.34.67:37837)
I20260805 22:58:48.069626 14285 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.67:43929
I20260805 22:58:48.072412 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:58:48.077941 14549 heartbeater.cc:503] Master 127.20.34.126:38281 was elected leader, sending a full tablet report...
I20260805 22:58:48.082840 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.076524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55054 (local address 127.20.34.126:38281)
0805 22:58:48.076787 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.076797 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.077227 (+ 430us) server_negotiation.cc:407] Connection header received
0805 22:58:48.077386 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.077389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.077455 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.077538 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:48.077995 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.078856 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.080505 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.080951 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.081091 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.082070 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:48.082077 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:48.082082 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:48.082109 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:48.082140 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:48.082152 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:48.082250 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.082413 (+ 163us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.082520 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:58:48.086907 14285 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:58:48.095333 14285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:58:48.139351 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.111120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48438 (local address 127.20.34.65:46507)
0805 22:58:48.128483 (+ 17363us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.128498 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.129235 (+ 737us) server_negotiation.cc:407] Connection header received
0805 22:58:48.129484 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.129500 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.129883 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.130156 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:48.131327 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.132845 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.136387 (+ 3542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.137831 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.137958 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.138230 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.138743 (+ 513us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.138940 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17094,"thread_start_us":16854,"threads_started":1}
I20260805 22:58:48.139951 14983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.110297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:46507 (local address 127.0.0.1:48438)
0805 22:58:48.129035 (+ 18738us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:48.129060 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:48.129257 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:48.130491 (+ 1234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:48.130498 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:48.130526 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:48.130983 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.130997 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.133006 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.133013 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.136110 (+ 3097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.136132 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.138217 (+ 2085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.138224 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.138387 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.138456 (+ 69us) client_negotiation.cc:769] Sending connection context
0805 22:58:48.138577 (+ 121us) client_negotiation.cc:240] Negotiation successful
0805 22:58:48.139674 (+ 1097us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18571,"mutex_wait_us":888,"thread_start_us":18404,"threads_started":1}
I20260805 22:58:48.140098 14978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.109579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:43291 (local address 127.0.0.1:57796)
0805 22:58:48.127249 (+ 17670us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:48.127279 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:48.127442 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:48.131557 (+ 4115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:48.131562 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:48.131593 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:48.132131 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.132176 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.134178 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.134209 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.136768 (+ 2559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.136782 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.139037 (+ 2255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.139045 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.139265 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.139322 (+ 57us) client_negotiation.cc:769] Sending connection context
0805 22:58:48.139431 (+ 109us) client_negotiation.cc:240] Negotiation successful
0805 22:58:48.139617 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17434,"mutex_wait_us":138,"thread_start_us":12860,"threads_started":1}
I20260805 22:58:48.140393 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.109737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45002 (local address 127.20.34.67:37837)
0805 22:58:48.130420 (+ 20683us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.130431 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.130471 (+ 40us) server_negotiation.cc:407] Connection header received
0805 22:58:48.130577 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.130583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.130767 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.131021 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:48.132255 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.133482 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.136037 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.137555 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.137706 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.138026 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.139626 (+ 1600us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.139839 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20467,"thread_start_us":20240,"threads_started":1}
I20260805 22:58:48.140964 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.110276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57796 (local address 127.20.34.66:43291)
0805 22:58:48.130944 (+ 20668us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.130955 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.130986 (+ 31us) server_negotiation.cc:407] Connection header received
0805 22:58:48.131084 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.131094 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.131327 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.131540 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:48.132394 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.133951 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.136980 (+ 3029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.138376 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.138578 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.138875 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.140414 (+ 1539us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.140623 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19984,"thread_start_us":19259,"threads_started":1}
I20260805 22:58:48.139379 14979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.109382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:37837 (local address 127.0.0.1:45002)
0805 22:58:48.123017 (+ 13635us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:48.123086 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:48.123366 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:48.131384 (+ 8018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:48.131388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:48.131412 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:48.131983 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.132004 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.133632 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.133637 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.135831 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.135844 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.137796 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.137805 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.138052 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.138122 (+ 70us) client_negotiation.cc:769] Sending connection context
0805 22:58:48.138585 (+ 463us) client_negotiation.cc:240] Negotiation successful
0805 22:58:48.138834 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13275,"mutex_wait_us":138,"thread_start_us":17441,"threads_started":1}
I20260805 22:58:48.144990 14642 tablet_service.cc:1467] Processing CreateTablet for tablet 513060aacd154f49953a5bad4010d38e (DEFAULT_TABLE table=test-table [id=de904a4aa56e4d90b2d27aa6c6b21bda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:48.144994 14455 tablet_service.cc:1467] Processing CreateTablet for tablet 513060aacd154f49953a5bad4010d38e (DEFAULT_TABLE table=test-table [id=de904a4aa56e4d90b2d27aa6c6b21bda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:48.145259 14862 tablet_service.cc:1467] Processing CreateTablet for tablet 513060aacd154f49953a5bad4010d38e (DEFAULT_TABLE table=test-table [id=de904a4aa56e4d90b2d27aa6c6b21bda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:48.146353 14642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 513060aacd154f49953a5bad4010d38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:48.146703 14455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 513060aacd154f49953a5bad4010d38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:48.146723 14862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 513060aacd154f49953a5bad4010d38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:48.158967 14985 tablet_bootstrap.cc:492] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Bootstrap starting.
I20260805 22:58:48.162374 14985 tablet_bootstrap.cc:654] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:48.163825 14985 log.cc:824] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:48.164861 14986 tablet_bootstrap.cc:492] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Bootstrap starting.
I20260805 22:58:48.165198 14988 tablet_bootstrap.cc:492] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Bootstrap starting.
I20260805 22:58:48.168799 14988 tablet_bootstrap.cc:654] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:48.169417 14986 tablet_bootstrap.cc:654] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:48.169965 14988 log.cc:824] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:48.170637 14986 log.cc:824] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:48.171326 14985 tablet_bootstrap.cc:492] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: No bootstrap required, opened a new log
I20260805 22:58:48.171725 14985 ts_tablet_manager.cc:1397] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260805 22:58:48.172927 14988 tablet_bootstrap.cc:492] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: No bootstrap required, opened a new log
I20260805 22:58:48.173157 14988 ts_tablet_manager.cc:1397] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260805 22:58:48.174626 14986 tablet_bootstrap.cc:492] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: No bootstrap required, opened a new log
I20260805 22:58:48.174862 14986 ts_tablet_manager.cc:1397] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260805 22:58:48.181061 14988 raft_consensus.cc:348] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.181435 14988 raft_consensus.cc:374] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:48.181555 14988 raft_consensus.cc:729] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4646dd7951c4b35a5325c49b748d0e9, State: Initialized, Role: FOLLOWER
I20260805 22:58:48.182202 14988 consensus_queue.cc:260] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.183290 14957 heartbeater.cc:503] Master 127.20.34.126:38281 was elected leader, sending a full tablet report...
I20260805 22:58:48.183025 14985 raft_consensus.cc:348] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.183430 14985 raft_consensus.cc:374] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:48.183537 14985 raft_consensus.cc:729] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517066a0104741308f4a7796c1a5c9e1, State: Initialized, Role: FOLLOWER
I20260805 22:58:48.184198 14985 consensus_queue.cc:260] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.185228 14988 ts_tablet_manager.cc:1428] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260805 22:58:48.185621 14986 raft_consensus.cc:348] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.186100 14986 raft_consensus.cc:374] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:48.186218 14986 raft_consensus.cc:729] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42fdf3ac55b74d6895e7873ba4c810a6, State: Initialized, Role: FOLLOWER
I20260805 22:58:48.186836 14986 consensus_queue.cc:260] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.188961 14986 ts_tablet_manager.cc:1428] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260805 22:58:48.189865 14749 heartbeater.cc:503] Master 127.20.34.126:38281 was elected leader, sending a full tablet report...
I20260805 22:58:48.191366 14985 ts_tablet_manager.cc:1428] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Time spent starting tablet: real 0.020s user 0.011s sys 0.007s
W20260805 22:58:48.300917 14958 tablet.cc:2369] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:58:48.306766 14551 tablet.cc:2369] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 22:58:48.307438 14751 tablet.cc:2369] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:58:48.488353 14995 raft_consensus.cc:482] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:58:48.488698 14995 raft_consensus.cc:504] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.490702 14995 leader_election.cc:288] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4646dd7951c4b35a5325c49b748d0e9 (127.20.34.67:37837), 42fdf3ac55b74d6895e7873ba4c810a6 (127.20.34.65:46507)
I20260805 22:58:48.498571 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.491137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:49633 (local address 127.20.34.67:37837)
0805 22:58:48.491352 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.491359 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.492220 (+ 861us) server_negotiation.cc:407] Connection header received
0805 22:58:48.492451 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.492461 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.492527 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.492631 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:48.493204 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.494179 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.496651 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.497557 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.497686 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.497736 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.498140 (+ 404us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.498281 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:58:48.498610 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.491222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:37837 (local address 127.20.34.66:49633)
0805 22:58:48.492066 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:48.492087 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:48.492283 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:48.492667 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:48.492672 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:48.492698 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:48.493058 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.493066 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.494335 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.494340 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.496410 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.496433 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.497751 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.497759 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.497950 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.497984 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:58:48.498078 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 22:58:48.498211 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"mutex_wait_us":26,"thread_start_us":440,"threads_started":1}
I20260805 22:58:48.498982 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.491327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:40007 (local address 127.20.34.65:46507)
0805 22:58:48.491574 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.491582 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.492744 (+ 1162us) server_negotiation.cc:407] Connection header received
0805 22:58:48.493038 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.493043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.493123 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.493220 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:48.493954 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.494892 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.497029 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.497961 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.498145 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.498210 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.498633 (+ 423us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.498779 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 22:58:48.499343 14998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.491239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:46507 (local address 127.20.34.66:40007)
0805 22:58:48.492632 (+ 1393us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:48.492646 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:48.492885 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:48.493234 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:48.493238 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:48.493260 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:48.493579 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.493588 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.495018 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.495024 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.496837 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:48.496854 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.498246 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.498252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:48.498412 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.498466 (+ 54us) client_negotiation.cc:769] Sending connection context
0805 22:58:48.498580 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 22:58:48.498918 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1280,"mutex_wait_us":24,"spinlock_wait_cycles":34432,"thread_start_us":1068,"threads_started":1}
I20260805 22:58:48.499960 14891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "513060aacd154f49953a5bad4010d38e" candidate_uuid: "517066a0104741308f4a7796c1a5c9e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4646dd7951c4b35a5325c49b748d0e9" is_pre_election: true
I20260805 22:58:48.500365 14485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "513060aacd154f49953a5bad4010d38e" candidate_uuid: "517066a0104741308f4a7796c1a5c9e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" is_pre_election: true
I20260805 22:58:48.500499 14891 raft_consensus.cc:2454] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 517066a0104741308f4a7796c1a5c9e1 in term 0.
I20260805 22:58:48.500837 14485 raft_consensus.cc:2454] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 517066a0104741308f4a7796c1a5c9e1 in term 0.
I20260805 22:58:48.501150 14578 leader_election.cc:302] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517066a0104741308f4a7796c1a5c9e1, a4646dd7951c4b35a5325c49b748d0e9; no voters:
I20260805 22:58:48.501612 14995 raft_consensus.cc:2781] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:58:48.501766 14995 raft_consensus.cc:482] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:58:48.501919 14995 raft_consensus.cc:3037] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:48.504213 14995 raft_consensus.cc:504] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.504865 14995 leader_election.cc:288] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [CANDIDATE]: Term 1 election: Requested vote from peers a4646dd7951c4b35a5325c49b748d0e9 (127.20.34.67:37837), 42fdf3ac55b74d6895e7873ba4c810a6 (127.20.34.65:46507)
I20260805 22:58:48.505445 14891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "513060aacd154f49953a5bad4010d38e" candidate_uuid: "517066a0104741308f4a7796c1a5c9e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4646dd7951c4b35a5325c49b748d0e9"
I20260805 22:58:48.505445 14485 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "513060aacd154f49953a5bad4010d38e" candidate_uuid: "517066a0104741308f4a7796c1a5c9e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42fdf3ac55b74d6895e7873ba4c810a6"
I20260805 22:58:48.505667 14485 raft_consensus.cc:3037] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:48.505668 14891 raft_consensus.cc:3037] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:48.509095 14891 raft_consensus.cc:2454] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517066a0104741308f4a7796c1a5c9e1 in term 1.
I20260805 22:58:48.509095 14485 raft_consensus.cc:2454] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 517066a0104741308f4a7796c1a5c9e1 in term 1.
I20260805 22:58:48.509542 14578 leader_election.cc:302] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 517066a0104741308f4a7796c1a5c9e1, a4646dd7951c4b35a5325c49b748d0e9; no voters:
I20260805 22:58:48.509864 14995 raft_consensus.cc:2781] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:48.510298 14995 raft_consensus.cc:686] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 1 LEADER]: Becoming Leader. State: Replica: 517066a0104741308f4a7796c1a5c9e1, State: Running, Role: LEADER
I20260805 22:58:48.510800 14995 consensus_queue.cc:237] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } }
I20260805 22:58:48.515921 14285 catalog_manager.cc:5495] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 517066a0104741308f4a7796c1a5c9e1 (127.20.34.66). New cstate: current_term: 1 leader_uuid: "517066a0104741308f4a7796c1a5c9e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "517066a0104741308f4a7796c1a5c9e1" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 43291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 } health_report { overall_health: UNKNOWN } } }
I20260805 22:58:48.603731 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.594928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57800 (local address 127.20.34.66:43291)
0805 22:58:48.595926 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.595934 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.596269 (+ 335us) server_negotiation.cc:407] Connection header received
0805 22:58:48.596542 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.596548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.596697 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.596857 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:58:48.597442 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.598577 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.601099 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.601516 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.601619 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.602299 (+ 680us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:58:48.602971 (+ 672us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:58:48.603146 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.603265 (+ 119us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.603363 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":802}
I20260805 22:58:48.614650 14485 raft_consensus.cc:1261] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 1 FOLLOWER]: Refusing update from remote peer 517066a0104741308f4a7796c1a5c9e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:48.615877 14999 consensus_queue.cc:1035] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42fdf3ac55b74d6895e7873ba4c810a6" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 46507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:48.616335 14891 raft_consensus.cc:1261] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 1 FOLLOWER]: Refusing update from remote peer 517066a0104741308f4a7796c1a5c9e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:48.617367 14999 consensus_queue.cc:1035] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4646dd7951c4b35a5325c49b748d0e9" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:48.632467 15006 mvcc.cc:205] Tried to move back new op lower bound from 7315336104392863744 to 7315336103984328704. Current Snapshot: MvccSnapshot[applied={T|T < 7315336104392863744}]
I20260805 22:58:48.635071 15008 mvcc.cc:205] Tried to move back new op lower bound from 7315336104392863744 to 7315336103984328704. Current Snapshot: MvccSnapshot[applied={T|T < 7315336104392863744}]
I20260805 22:58:48.654014 14285 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:48.654312 14285 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:48.658073 14285 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b9295ca64c75474e9b6ec5d76a882335: Sending DeleteTablet for 3 replicas of tablet 513060aacd154f49953a5bad4010d38e
I20260805 22:58:48.659304 14862 tablet_service.cc:1514] Processing DeleteTablet for tablet 513060aacd154f49953a5bad4010d38e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:48 UTC) from {username='slave'} at 127.0.0.1:45002
I20260805 22:58:48.659353 14642 tablet_service.cc:1514] Processing DeleteTablet for tablet 513060aacd154f49953a5bad4010d38e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:48 UTC) from {username='slave'} at 127.0.0.1:57796
I20260805 22:58:48.659412 14455 tablet_service.cc:1514] Processing DeleteTablet for tablet 513060aacd154f49953a5bad4010d38e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:48 UTC) from {username='slave'} at 127.0.0.1:48438
I20260805 22:58:48.664036 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 14367
I20260805 22:58:48.671701 15019 tablet_replica.cc:330] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: stopping tablet replica
I20260805 22:58:48.672508 15019 raft_consensus.cc:2229] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:48.673308 15019 raft_consensus.cc:2258] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:48.675715 15018 tablet_replica.cc:330] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: stopping tablet replica
I20260805 22:58:48.676049 15019 ts_tablet_manager.cc:1905] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:48.676632 15018 raft_consensus.cc:2229] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:58:48.677924 15018 raft_consensus.cc:2258] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:48.682101 15018 ts_tablet_manager.cc:1905] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:48.684911 15019 ts_tablet_manager.cc:1918] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:48.685154 15019 log.cc:1196] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/513060aacd154f49953a5bad4010d38e
I20260805 22:58:48.685906 15020 tablet_replica.cc:330] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: stopping tablet replica
I20260805 22:58:48.686368 15019 ts_tablet_manager.cc:1939] T 513060aacd154f49953a5bad4010d38e P 42fdf3ac55b74d6895e7873ba4c810a6: Deleting consensus metadata
I20260805 22:58:48.688306 15020 raft_consensus.cc:2229] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:48.689009 15020 raft_consensus.cc:2258] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:48.688827 14264 catalog_manager.cc:4841] TS 42fdf3ac55b74d6895e7873ba4c810a6 (127.20.34.65:46507): tablet 513060aacd154f49953a5bad4010d38e (table test-table [id=de904a4aa56e4d90b2d27aa6c6b21bda]) successfully deleted
I20260805 22:58:48.690536 15018 ts_tablet_manager.cc:1918] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:48.690726 15018 log.cc:1196] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/513060aacd154f49953a5bad4010d38e
I20260805 22:58:48.691270 15020 ts_tablet_manager.cc:1905] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:48.691326 15018 ts_tablet_manager.cc:1939] T 513060aacd154f49953a5bad4010d38e P 517066a0104741308f4a7796c1a5c9e1: Deleting consensus metadata
I20260805 22:58:48.693221 14267 catalog_manager.cc:4841] TS 517066a0104741308f4a7796c1a5c9e1 (127.20.34.66:43291): tablet 513060aacd154f49953a5bad4010d38e (table test-table [id=de904a4aa56e4d90b2d27aa6c6b21bda]) successfully deleted
I20260805 22:58:48.694509 14984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.667243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48448 (local address 127.20.34.65:46507)
0805 22:58:48.667449 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.667456 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.680976 (+ 13520us) server_negotiation.cc:407] Connection header received
0805 22:58:48.681288 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.681294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.681422 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.681503 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:48.682229 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.683457 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.686588 (+ 3131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.687278 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.687383 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.692717 (+ 5334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:48.692730 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:48.692751 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:48.693532 (+ 781us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:48.693597 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:48.693628 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:48.693750 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.693998 (+ 248us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.694132 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:58:48.695703 14542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:48.700103 15020 ts_tablet_manager.cc:1918] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:48.700320 15020 log.cc:1196] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/513060aacd154f49953a5bad4010d38e
I20260805 22:58:48.700793 15020 ts_tablet_manager.cc:1939] T 513060aacd154f49953a5bad4010d38e P a4646dd7951c4b35a5325c49b748d0e9: Deleting consensus metadata
I20260805 22:58:48.702394 14262 catalog_manager.cc:4841] TS a4646dd7951c4b35a5325c49b748d0e9 (127.20.34.67:37837): tablet 513060aacd154f49953a5bad4010d38e (table test-table [id=de904a4aa56e4d90b2d27aa6c6b21bda]) successfully deleted
I20260805 22:58:48.801358 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 14367
I20260805 22:58:48.831446 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 14555
I20260805 22:58:48.839893 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.832567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57806 (local address 127.20.34.66:43291)
0805 22:58:48.832815 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.832821 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.832844 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:58:48.833027 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.833032 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.833132 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.833301 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:48.833755 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.834654 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.836201 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.836793 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.836962 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.838214 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:48.838224 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:48.838247 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:48.838975 (+ 728us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:48.839030 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:48.839052 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:48.839199 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.839354 (+ 155us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.839470 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:58:48.840787 14743 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:48.957669 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 14555
I20260805 22:58:48.983731 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 14758
I20260805 22:58:48.991472 14981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:48.984660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45006 (local address 127.20.34.67:37837)
0805 22:58:48.984890 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:48.984895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:48.984915 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:58:48.985032 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:48.985036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:48.985138 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:48.985225 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:48.985606 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.986449 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.987976 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:48.988677 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:48.988823 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:48.990179 (+ 1356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:48.990188 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:48.990205 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:48.990801 (+ 596us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:48.990850 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:48.990871 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:48.991025 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:48.991120 (+ 95us) server_negotiation.cc:299] Negotiation successful
0805 22:58:48.991211 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 22:58:48.992377 14952 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:49.082176 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 14758
I20260805 22:58:49.109661 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 14243
I20260805 22:58:49.111044 14331 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:49.225745 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 14243
2026-08-05T22:58:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3377 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:58:49 dist-test-slave-gmjp krb5kdc[15031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:58:49 dist-test-slave-gmjp krb5kdc[15031](info): set up 2 sockets
Aug 05 22:58:49 dist-test-slave-gmjp krb5kdc[15031](info): commencing operation
krb5kdc: starting...
W20260805 22:58:50.590937 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.314s user 0.002s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:58:50 dist-test-slave-gmjp krb5kdc[15031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:58:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:58:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:58:50.949869 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:33383
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:41185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:33383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:58:51.321044 15048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:51.321445 15048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:51.321615 15048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:51.330245 15048 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:58:51.330488 15048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:51.330646 15048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:51.330789 15048 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:58:51.330890 15048 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:58:51.342916 15048 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:33383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:33383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:51.344740 15048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:51.346284 15048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:51.360757 15060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:51.360743 15057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:51.360708 15054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:51.361672 15048 server_base.cc:1034] running on GCE node
I20260805 22:58:51.362576 15048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:51.364102 15048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:51.365367 15048 hybrid_clock.cc:648] HybridClock initialized: now 1785970731365312 us; error 41 us; skew 500 ppm
I20260805 22:58:51.365746 15048 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:51 dist-test-slave-gmjp krb5kdc[15031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970731, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:51.369047 15048 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:58:51.370785 15048 webserver.cc:460] Webserver started at http://127.20.34.126:38349/ using document root <none> and password file <none>
I20260805 22:58:51.371575 15048 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:51.371783 15048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:51.372227 15048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:51.375752 15048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "2fbb92a3ab36452e85a8625b66c5a835"
format_stamp: "Formatted at 2026-08-05 22:58:51 on dist-test-slave-gmjp"
server_key: "f7a5bce6677909328999f5f9a447c9fb"
server_key_iv: "01b3497ae55b65a0d5df4a789ed2f583"
server_key_version: "encryptionkey@0"
I20260805 22:58:51.376730 15048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "2fbb92a3ab36452e85a8625b66c5a835"
format_stamp: "Formatted at 2026-08-05 22:58:51 on dist-test-slave-gmjp"
server_key: "f7a5bce6677909328999f5f9a447c9fb"
server_key_iv: "01b3497ae55b65a0d5df4a789ed2f583"
server_key_version: "encryptionkey@0"
I20260805 22:58:51.382381 15048 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260805 22:58:51.386189 15070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:51.387905 15048 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:58:51.388128 15048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "2fbb92a3ab36452e85a8625b66c5a835"
format_stamp: "Formatted at 2026-08-05 22:58:51 on dist-test-slave-gmjp"
server_key: "f7a5bce6677909328999f5f9a447c9fb"
server_key_iv: "01b3497ae55b65a0d5df4a789ed2f583"
server_key_version: "encryptionkey@0"
I20260805 22:58:51.388442 15048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:51.410100 15048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:51.414700 15048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:51.415030 15048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:51.435046 15048 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:33383
I20260805 22:58:51.435070 15139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:33383 every 8 connection(s)
I20260805 22:58:51.436556 15048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:58:51.440768 15140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:51.446516 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 15048
I20260805 22:58:51.446724 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:58:51.447343 20617 external_mini_cluster.cc:1428] Setting key dd8f96cc4d532318a3b3dfd38e6de3d1
I20260805 22:58:51.453053 15140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835: Bootstrap starting.
I20260805 22:58:51.457136 15140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:51.458467 15140 log.cc:824] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:51.462502 15140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835: No bootstrap required, opened a new log
Aug 05 22:58:51 dist-test-slave-gmjp krb5kdc[15031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:51.473659 15140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fbb92a3ab36452e85a8625b66c5a835" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33383 } }
I20260805 22:58:51.474118 15140 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:51.474236 15140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbb92a3ab36452e85a8625b66c5a835, State: Initialized, Role: FOLLOWER
I20260805 22:58:51.475080 15140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fbb92a3ab36452e85a8625b66c5a835" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33383 } }
I20260805 22:58:51.475489 15140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:58:51.475689 15140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:58:51.475926 15140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:51.476953 15145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:51.449606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52396 (local address 127.20.34.126:33383)
0805 22:58:51.450554 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:51.450565 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:51.450612 (+ 47us) server_negotiation.cc:407] Connection header received
0805 22:58:51.452526 (+ 1914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:51.452550 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:51.452950 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:51.453334 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:51.455388 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:51.456946 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:51.459098 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:51.460353 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:51.460539 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:51.467318 (+ 6779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:51.467343 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:51.467389 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:51.467464 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:51.471839 (+ 4375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:51.472853 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:51.472864 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:51.472876 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:51.473084 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:51.473535 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:51.473542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:51.473545 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:51.474251 (+ 706us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:51.474567 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:51.475081 (+ 514us) server_negotiation.cc:299] Negotiation successful
0805 22:58:51.475551 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":454,"threads_started":1}
I20260805 22:58:51.478874 15140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fbb92a3ab36452e85a8625b66c5a835" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33383 } }
I20260805 22:58:51.479746 15140 leader_election.cc:302] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fbb92a3ab36452e85a8625b66c5a835; no voters:
I20260805 22:58:51.480907 15140 leader_election.cc:288] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:58:51.481029 15147 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:51.482288 15147 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbb92a3ab36452e85a8625b66c5a835, State: Running, Role: LEADER
I20260805 22:58:51.482800 15147 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fbb92a3ab36452e85a8625b66c5a835" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33383 } }
I20260805 22:58:51.483328 15140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:58:51.488778 15150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fbb92a3ab36452e85a8625b66c5a835" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fbb92a3ab36452e85a8625b66c5a835" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33383 } } }
I20260805 22:58:51.489619 15150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:51.488916 15152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fbb92a3ab36452e85a8625b66c5a835. Latest consensus state: current_term: 1 leader_uuid: "2fbb92a3ab36452e85a8625b66c5a835" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fbb92a3ab36452e85a8625b66c5a835" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33383 } } }
I20260805 22:58:51.490374 15152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:51.501772 15163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:58:51.507499 15163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:58:51.517809 15163 catalog_manager.cc:1347] Generated new cluster ID: 4aeb8658a03444af86b51fa504f7be7e
I20260805 22:58:51.518085 15163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:58:51.534062 15163 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:58:51.536034 15163 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:58:51.557264 15163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835: Generated new TSK 0
I20260805 22:58:51.558535 15163 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:58:51.639992 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33383
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:41185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:58:52.005785 15182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:52.006109 15182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:52.006215 15182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:52.013664 15182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:52.013810 15182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:52.013947 15182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:58:52.024080 15182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:52.025523 15182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:52.026835 15182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:52.041460 15187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:52.041498 15188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:52.041661 15190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:52.042521 15182 server_base.cc:1034] running on GCE node
I20260805 22:58:52.043226 15182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:52.044386 15182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:52.045634 15182 hybrid_clock.cc:648] HybridClock initialized: now 1785970732045593 us; error 52 us; skew 500 ppm
I20260805 22:58:52.046022 15182 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:52 dist-test-slave-gmjp krb5kdc[15031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:52.049494 15182 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:58:52.051110 15182 webserver.cc:460] Webserver started at http://127.20.34.65:43795/ using document root <none> and password file <none>
I20260805 22:58:52.051831 15182 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:52.051982 15182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:52.052374 15182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:52.055500 15182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "bf207b3f861b4dd2b0acbd423ccf707d"
format_stamp: "Formatted at 2026-08-05 22:58:52 on dist-test-slave-gmjp"
server_key: "7ba38b8f5d906043e0efba78fee33d38"
server_key_iv: "fc1d8ce38f26218eaf996140e6e9451f"
server_key_version: "encryptionkey@0"
I20260805 22:58:52.056401 15182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "bf207b3f861b4dd2b0acbd423ccf707d"
format_stamp: "Formatted at 2026-08-05 22:58:52 on dist-test-slave-gmjp"
server_key: "7ba38b8f5d906043e0efba78fee33d38"
server_key_iv: "fc1d8ce38f26218eaf996140e6e9451f"
server_key_version: "encryptionkey@0"
I20260805 22:58:52.062386 15182 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:58:52.066279 15204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:52.067662 15182 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:58:52.067884 15182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "bf207b3f861b4dd2b0acbd423ccf707d"
format_stamp: "Formatted at 2026-08-05 22:58:52 on dist-test-slave-gmjp"
server_key: "7ba38b8f5d906043e0efba78fee33d38"
server_key_iv: "fc1d8ce38f26218eaf996140e6e9451f"
server_key_version: "encryptionkey@0"
I20260805 22:58:52.068104 15182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:52.092316 15182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:52.097211 15182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:52.097534 15182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:52.098630 15182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:52.100054 15182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:52.100193 15182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:52.100364 15182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:52.100441 15182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:52.136601 15182 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:45595
I20260805 22:58:52.136662 15370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:45595 every 8 connection(s)
I20260805 22:58:52.137969 15182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:58:52.146450 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 15182
I20260805 22:58:52.146667 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:58:52.147138 20617 external_mini_cluster.cc:1428] Setting key 5189a1a577ba4a69cac59052d4c91712
Aug 05 22:58:52 dist-test-slave-gmjp krb5kdc[15031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:52.159775 15375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:52.140819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:56719 (local address 127.20.34.126:33383)
0805 22:58:52.141312 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:52.141317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:52.142372 (+ 1055us) server_negotiation.cc:407] Connection header received
0805 22:58:52.144349 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:52.144357 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:52.144456 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:52.144582 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:52.146211 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:52.147078 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:52.148939 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:52.149355 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:52.149503 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:52.153280 (+ 3777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:52.153285 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:52.153289 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:52.153324 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:52.156252 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:52.157121 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:52.157134 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:52.157136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:52.157265 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:52.157804 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:52.157808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:52.157810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:52.158089 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:52.158260 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:52.159120 (+ 860us) server_negotiation.cc:299] Negotiation successful
0805 22:58:52.159374 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":242,"threads_started":1}
I20260805 22:58:52.160951 15376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:52.141366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33383 (local address 127.20.34.65:56719)
0805 22:58:52.142193 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:52.142231 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:52.144010 (+ 1779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:52.144843 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:52.144851 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:52.145405 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:52.146000 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:52.146053 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:52.147244 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:52.147252 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:52.148788 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:52.148801 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:52.149603 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:52.149611 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:52.149864 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:52.150645 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:52.150670 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:52.153030 (+ 2360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:52.156423 (+ 3393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:52.156433 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:52.156456 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:52.156971 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:52.157389 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:52.157394 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:52.157398 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:52.157669 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:52.158234 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:52.158244 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:52.158685 (+ 441us) client_negotiation.cc:769] Sending connection context
0805 22:58:52.158985 (+ 300us) client_negotiation.cc:240] Negotiation successful
0805 22:58:52.159603 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":370,"threads_started":1}
I20260805 22:58:52.162776 15371 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33383
I20260805 22:58:52.163125 15371 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:52.163903 15371 heartbeater.cc:511] Master 127.20.34.126:33383 requested a full tablet report, sending...
I20260805 22:58:52.166167 15093 ts_manager.cc:194] Registered new tserver with Master: bf207b3f861b4dd2b0acbd423ccf707d (127.20.34.65:45595)
I20260805 22:58:52.167663 15093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:56719
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:58:52.224577 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33383
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:41185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:58:52.602265 15380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:52.602588 15380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:52.602825 15380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:52.610455 15380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:52.610630 15380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:52.610852 15380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:58:52.621345 15380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:52.622879 15380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:52.624415 15380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:52.639778 15385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:52.639740 15386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:52.639688 15388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:52.641213 15380 server_base.cc:1034] running on GCE node
I20260805 22:58:52.641981 15380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:52.643115 15380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:52.644363 15380 hybrid_clock.cc:648] HybridClock initialized: now 1785970732644299 us; error 61 us; skew 500 ppm
I20260805 22:58:52.644729 15380 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:52 dist-test-slave-gmjp krb5kdc[15031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:52.648350 15380 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:58:52.650113 15380 webserver.cc:460] Webserver started at http://127.20.34.66:35513/ using document root <none> and password file <none>
I20260805 22:58:52.650929 15380 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:52.651087 15380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:52.651448 15380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:52.654688 15380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "250e177fea3149cf859b507474d06451"
format_stamp: "Formatted at 2026-08-05 22:58:52 on dist-test-slave-gmjp"
server_key: "62b87c041284b5ae319e49c6549ccb3e"
server_key_iv: "098556db67c063dc34baf34263d2537b"
server_key_version: "encryptionkey@0"
I20260805 22:58:52.655526 15380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "250e177fea3149cf859b507474d06451"
format_stamp: "Formatted at 2026-08-05 22:58:52 on dist-test-slave-gmjp"
server_key: "62b87c041284b5ae319e49c6549ccb3e"
server_key_iv: "098556db67c063dc34baf34263d2537b"
server_key_version: "encryptionkey@0"
I20260805 22:58:52.661689 15380 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.001s
I20260805 22:58:52.665373 15397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:52.666734 15380 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:58:52.666929 15380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "250e177fea3149cf859b507474d06451"
format_stamp: "Formatted at 2026-08-05 22:58:52 on dist-test-slave-gmjp"
server_key: "62b87c041284b5ae319e49c6549ccb3e"
server_key_iv: "098556db67c063dc34baf34263d2537b"
server_key_version: "encryptionkey@0"
I20260805 22:58:52.667155 15380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:52.687606 15380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:52.693077 15380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:52.693447 15380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:52.694588 15380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:52.696275 15380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:52.696381 15380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:52.696542 15380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:52.696635 15380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:52.731997 15380 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:38619
I20260805 22:58:52.732089 15563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:38619 every 8 connection(s)
I20260805 22:58:52.733422 15380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:58:52.742017 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 15380
I20260805 22:58:52.742218 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:58:52.742681 20617 external_mini_cluster.cc:1428] Setting key 4892562e38ae9f841bb463ec7eb6e114
Aug 05 22:58:52 dist-test-slave-gmjp krb5kdc[15031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970732, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:52.755118 15567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:52.736305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:48035 (local address 127.20.34.126:33383)
0805 22:58:52.736762 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:52.736767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:52.737908 (+ 1141us) server_negotiation.cc:407] Connection header received
0805 22:58:52.739918 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:52.739924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:52.740022 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:52.740150 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:52.741924 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:52.742901 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:52.744942 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:52.745379 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:52.745523 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:52.749159 (+ 3636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:52.749164 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:52.749167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:52.749203 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:52.751876 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:52.752723 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:52.752729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:52.752732 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:52.752869 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:52.753324 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:52.753337 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:52.753339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:52.753605 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:52.753765 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:52.754498 (+ 733us) server_negotiation.cc:299] Negotiation successful
0805 22:58:52.754726 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":227,"threads_started":1}
I20260805 22:58:52.756347 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:52.736957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33383 (local address 127.20.34.66:48035)
0805 22:58:52.737719 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:52.737772 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:52.739599 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:52.740437 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:52.740446 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:52.741017 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:52.741697 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:52.741726 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:52.743078 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:52.743083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:52.744792 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:52.744804 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:52.745625 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:52.745632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:52.745870 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:52.746590 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:52.746619 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:52.748896 (+ 2277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:52.752039 (+ 3143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:52.752048 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:52.752067 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:52.752585 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:52.752986 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:52.752991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:52.752995 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:52.753199 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:52.753739 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:52.753748 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:52.754115 (+ 367us) client_negotiation.cc:769] Sending connection context
0805 22:58:52.754399 (+ 284us) client_negotiation.cc:240] Negotiation successful
0805 22:58:52.754991 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":290,"threads_started":1}
I20260805 22:58:52.758034 15564 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33383
I20260805 22:58:52.758378 15564 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:52.759243 15564 heartbeater.cc:511] Master 127.20.34.126:33383 requested a full tablet report, sending...
I20260805 22:58:52.760998 15093 ts_manager.cc:194] Registered new tserver with Master: 250e177fea3149cf859b507474d06451 (127.20.34.66:38619)
I20260805 22:58:52.761854 15093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:48035
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:58:52.824661 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33383
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:41185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:58:53.171047 15371 heartbeater.cc:503] Master 127.20.34.126:33383 was elected leader, sending a full tablet report...
W20260805 22:58:53.197867 15574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:53.198251 15574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:53.198522 15574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:53.206946 15574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:53.207132 15574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:53.207334 15574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:58:53.217540 15574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33383
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:53.219066 15574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:53.220494 15574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:53.234301 15580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:53.234315 15581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:53.234594 15589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:53.235159 15574 server_base.cc:1034] running on GCE node
I20260805 22:58:53.235821 15574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:53.236999 15574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:53.238255 15574 hybrid_clock.cc:648] HybridClock initialized: now 1785970733238175 us; error 73 us; skew 500 ppm
I20260805 22:58:53.238690 15574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:53 dist-test-slave-gmjp krb5kdc[15031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970733, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:53.242342 15574 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:58:53.244063 15574 webserver.cc:460] Webserver started at http://127.20.34.67:45397/ using document root <none> and password file <none>
I20260805 22:58:53.244843 15574 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:53.245004 15574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:53.245378 15574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:53.248607 15574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "d1c5e83b315e46bab4ccbfbecf69fd22"
format_stamp: "Formatted at 2026-08-05 22:58:53 on dist-test-slave-gmjp"
server_key: "47b8ea655effa8c269a269d8d28f912d"
server_key_iv: "78208d7833c6a896d88b1a70641f8bc6"
server_key_version: "encryptionkey@0"
I20260805 22:58:53.249439 15574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "d1c5e83b315e46bab4ccbfbecf69fd22"
format_stamp: "Formatted at 2026-08-05 22:58:53 on dist-test-slave-gmjp"
server_key: "47b8ea655effa8c269a269d8d28f912d"
server_key_iv: "78208d7833c6a896d88b1a70641f8bc6"
server_key_version: "encryptionkey@0"
I20260805 22:58:53.255136 15574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:58:53.259224 15602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:53.260942 15574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:58:53.261157 15574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "d1c5e83b315e46bab4ccbfbecf69fd22"
format_stamp: "Formatted at 2026-08-05 22:58:53 on dist-test-slave-gmjp"
server_key: "47b8ea655effa8c269a269d8d28f912d"
server_key_iv: "78208d7833c6a896d88b1a70641f8bc6"
server_key_version: "encryptionkey@0"
I20260805 22:58:53.261415 15574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:53.279958 15574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:53.284744 15574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:53.285107 15574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:53.286201 15574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:53.287822 15574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:53.287907 15574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:53.288086 15574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:53.288146 15574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:53.323884 15574 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:35183
I20260805 22:58:53.323920 15760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:35183 every 8 connection(s)
I20260805 22:58:53.325536 15574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:58:53.332551 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 15574
I20260805 22:58:53.332825 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:58:53.333364 20617 external_mini_cluster.cc:1428] Setting key 6d92c04f74d582e8438843f2f8a5bb07
Aug 05 22:58:53 dist-test-slave-gmjp krb5kdc[15031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970733, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:53.347659 15763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.328599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:35121 (local address 127.20.34.126:33383)
0805 22:58:53.329115 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.329120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.330324 (+ 1204us) server_negotiation.cc:407] Connection header received
0805 22:58:53.332302 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.332308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.332411 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.332538 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:53.334408 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.335459 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.337254 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.337682 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.337827 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.341537 (+ 3710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:53.341544 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:53.341548 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:53.341594 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:53.344368 (+ 2774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:53.345162 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:53.345167 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:53.345172 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:53.345307 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:53.345769 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:53.345773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:53.345775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:53.346053 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:53.346220 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.347004 (+ 784us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.347245 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":265,"threads_started":1}
I20260805 22:58:53.348814 15766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.329274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33383 (local address 127.20.34.67:35121)
0805 22:58:53.330055 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.330095 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:53.331949 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:53.332804 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:53.332813 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:53.333423 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:53.334219 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.334241 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.335628 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.335632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.337105 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.337118 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.337950 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.337958 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.338199 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.338959 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:58:53.338985 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:53.341304 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:53.344527 (+ 3223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:53.344537 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:53.344564 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:53.345017 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:53.345429 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:58:53.345434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:58:53.345438 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:58:53.345637 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:58:53.346188 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:53.346196 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:53.346577 (+ 381us) client_negotiation.cc:769] Sending connection context
0805 22:58:53.346886 (+ 309us) client_negotiation.cc:240] Negotiation successful
0805 22:58:53.347459 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":316,"threads_started":1}
I20260805 22:58:53.350334 15761 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33383
I20260805 22:58:53.350685 15761 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:53.351478 15761 heartbeater.cc:511] Master 127.20.34.126:33383 requested a full tablet report, sending...
I20260805 22:58:53.352967 15093 ts_manager.cc:194] Registered new tserver with Master: d1c5e83b315e46bab4ccbfbecf69fd22 (127.20.34.67:35183)
I20260805 22:58:53.353839 15093 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:35121
I20260805 22:58:53.362306 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:58:53.381136 15763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.367000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39664 (local address 127.20.34.126:33383)
0805 22:58:53.367201 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.367206 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.367598 (+ 392us) server_negotiation.cc:407] Connection header received
0805 22:58:53.367792 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.367796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.367868 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.367965 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:53.369545 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.370356 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.371949 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.372531 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.372716 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.375469 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:53.375475 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:53.375479 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:53.375518 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:53.378373 (+ 2855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:53.379230 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:53.379234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:53.379236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:53.379357 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:53.379764 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:53.379767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:53.379770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:53.380083 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:53.380376 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.380711 (+ 335us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.380899 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 22:58:53.385571 15093 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:58:53.392999 15093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:58:53.421723 15781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.406827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.20.34.66:38619)
0805 22:58:53.407489 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.407501 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.408114 (+ 613us) server_negotiation.cc:407] Connection header received
0805 22:58:53.408478 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.408486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.408750 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.408967 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:53.410198 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.412264 (+ 2066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.417626 (+ 5362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.420269 (+ 2643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.420432 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.420624 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.421182 (+ 558us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.421359 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":365,"threads_started":1}
I20260805 22:58:53.422264 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.406661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:38619 (local address 127.0.0.1:52528)
0805 22:58:53.407948 (+ 1287us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.407988 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:53.408224 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:53.409239 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:53.409249 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:53.409284 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:53.409757 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.409772 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.412487 (+ 2715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.412496 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.417349 (+ 4853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.417373 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.420732 (+ 3359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.420737 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.420914 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.420957 (+ 43us) client_negotiation.cc:769] Sending connection context
0805 22:58:53.421120 (+ 163us) client_negotiation.cc:240] Negotiation successful
0805 22:58:53.421341 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1051,"thread_start_us":902,"threads_started":1}
I20260805 22:58:53.426666 15464 tablet_service.cc:1467] Processing CreateTablet for tablet 999d414c52324567906b885b6590aa59 (DEFAULT_TABLE table=test-table [id=2063161e9ba04f09a971c5675ce998b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:53.428203 15464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999d414c52324567906b885b6590aa59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:53.428674 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.409726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59940 (local address 127.20.34.65:45595)
0805 22:58:53.420544 (+ 10818us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.420553 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.420585 (+ 32us) server_negotiation.cc:407] Connection header received
0805 22:58:53.420694 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.420703 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.420945 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.421842 (+ 897us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:53.422247 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.423894 (+ 1647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.425819 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.426768 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.426940 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.427186 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.428177 (+ 991us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.428340 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10623,"thread_start_us":10424,"threads_started":1}
I20260805 22:58:53.428710 15784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.409056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:59940)
0805 22:58:53.417411 (+ 8355us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.417436 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:53.417598 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:53.421473 (+ 3875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:53.421478 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:53.421512 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:53.422021 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.422041 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.424043 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.424048 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.425653 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.425665 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.426989 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.426996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.427164 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.427198 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:58:53.428094 (+ 896us) client_negotiation.cc:240] Negotiation successful
0805 22:58:53.428267 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8168,"mutex_wait_us":1,"thread_start_us":8664,"threads_started":1}
I20260805 22:58:53.432423 15276 tablet_service.cc:1467] Processing CreateTablet for tablet 999d414c52324567906b885b6590aa59 (DEFAULT_TABLE table=test-table [id=2063161e9ba04f09a971c5675ce998b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:53.433213 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.408452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:35183 (local address 127.0.0.1:54096)
0805 22:58:53.409031 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.409052 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:53.409163 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:53.419438 (+ 10275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:53.419442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:53.419472 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:53.419781 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.419790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.421798 (+ 2008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.421803 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.424048 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.424067 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.432381 (+ 8314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.432388 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.432562 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.432603 (+ 41us) client_negotiation.cc:769] Sending connection context
0805 22:58:53.432719 (+ 116us) client_negotiation.cc:240] Negotiation successful
0805 22:58:53.432857 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":284,"threads_started":1}
I20260805 22:58:53.433287 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.408851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54096 (local address 127.20.34.67:35183)
0805 22:58:53.418489 (+ 9638us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.418500 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.418544 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:58:53.418660 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.418669 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.418997 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.419226 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:53.419972 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.421602 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.427533 (+ 5931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.429551 (+ 2018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.432332 (+ 2781us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.432565 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.432773 (+ 208us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.432932 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9414,"thread_start_us":9246,"threads_started":1}
I20260805 22:58:53.434232 15276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999d414c52324567906b885b6590aa59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:53.436928 15668 tablet_service.cc:1467] Processing CreateTablet for tablet 999d414c52324567906b885b6590aa59 (DEFAULT_TABLE table=test-table [id=2063161e9ba04f09a971c5675ce998b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:53.438237 15668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999d414c52324567906b885b6590aa59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:53.451275 15786 tablet_bootstrap.cc:492] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Bootstrap starting.
I20260805 22:58:53.453476 15788 tablet_bootstrap.cc:492] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: Bootstrap starting.
I20260805 22:58:53.455343 15786 tablet_bootstrap.cc:654] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:53.456763 15786 log.cc:824] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:53.457146 15788 tablet_bootstrap.cc:654] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:53.458506 15788 log.cc:824] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:53.460948 15791 tablet_bootstrap.cc:492] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Bootstrap starting.
I20260805 22:58:53.462055 15786 tablet_bootstrap.cc:492] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: No bootstrap required, opened a new log
I20260805 22:58:53.462370 15786 ts_tablet_manager.cc:1397] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260805 22:58:53.462805 15788 tablet_bootstrap.cc:492] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: No bootstrap required, opened a new log
I20260805 22:58:53.463068 15788 ts_tablet_manager.cc:1397] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260805 22:58:53.464637 15791 tablet_bootstrap.cc:654] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:53.465934 15791 log.cc:824] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:53.469430 15791 tablet_bootstrap.cc:492] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: No bootstrap required, opened a new log
I20260805 22:58:53.469712 15791 ts_tablet_manager.cc:1397] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260805 22:58:53.471683 15786 raft_consensus.cc:348] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.472195 15786 raft_consensus.cc:374] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:53.472306 15786 raft_consensus.cc:729] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 250e177fea3149cf859b507474d06451, State: Initialized, Role: FOLLOWER
I20260805 22:58:53.473037 15786 consensus_queue.cc:260] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.474231 15564 heartbeater.cc:503] Master 127.20.34.126:33383 was elected leader, sending a full tablet report...
I20260805 22:58:53.473954 15788 raft_consensus.cc:348] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.474408 15788 raft_consensus.cc:374] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:53.474515 15788 raft_consensus.cc:729] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf207b3f861b4dd2b0acbd423ccf707d, State: Initialized, Role: FOLLOWER
I20260805 22:58:53.474967 15786 ts_tablet_manager.cc:1428] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Time spent starting tablet: real 0.012s user 0.006s sys 0.007s
I20260805 22:58:53.475222 15788 consensus_queue.cc:260] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.477020 15788 ts_tablet_manager.cc:1428] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260805 22:58:53.480873 15791 raft_consensus.cc:348] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.481320 15791 raft_consensus.cc:374] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:53.481420 15791 raft_consensus.cc:729] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c5e83b315e46bab4ccbfbecf69fd22, State: Initialized, Role: FOLLOWER
I20260805 22:58:53.481999 15791 consensus_queue.cc:260] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.483068 15761 heartbeater.cc:503] Master 127.20.34.126:33383 was elected leader, sending a full tablet report...
I20260805 22:58:53.483757 15791 ts_tablet_manager.cc:1428] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
W20260805 22:58:53.485595 15565 tablet.cc:2369] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:58:53.572461 15795 raft_consensus.cc:482] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:58:53.572851 15795 raft_consensus.cc:504] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.574963 15795 leader_election.cc:288] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1c5e83b315e46bab4ccbfbecf69fd22 (127.20.34.67:35183), bf207b3f861b4dd2b0acbd423ccf707d (127.20.34.65:45595)
W20260805 22:58:53.577392 15762 tablet.cc:2369] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:58:53.582870 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.575450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:46617 (local address 127.20.34.67:35183)
0805 22:58:53.575703 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.575710 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.576072 (+ 362us) server_negotiation.cc:407] Connection header received
0805 22:58:53.576459 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.576470 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.576582 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.576663 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:53.577841 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.578951 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.580957 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.581774 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.581998 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.582095 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.582437 (+ 342us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.582574 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:58:53.582898 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.576425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:55371 (local address 127.20.34.65:45595)
0805 22:58:53.576949 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.576953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.577124 (+ 171us) server_negotiation.cc:407] Connection header received
0805 22:58:53.577463 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.577470 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.577558 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.577638 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:53.578572 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.579284 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.581129 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.581919 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.582105 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.582185 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.582494 (+ 309us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.582629 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371}
I20260805 22:58:53.583087 15802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.575242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:35183 (local address 127.20.34.66:46617)
0805 22:58:53.575962 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.575985 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:53.576229 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:53.577107 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:53.577113 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:53.577144 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:53.577624 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.577641 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.579097 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.579106 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.580771 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.580784 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.582036 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.582043 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.582250 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.582281 (+ 31us) client_negotiation.cc:769] Sending connection context
0805 22:58:53.582406 (+ 125us) client_negotiation.cc:240] Negotiation successful
0805 22:58:53.582547 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":1,"spinlock_wait_cycles":27392,"thread_start_us":373,"threads_started":1}
I20260805 22:58:53.583307 15803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.576119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.20.34.66:55371)
0805 22:58:53.577006 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.577026 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:53.577254 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:53.577884 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:53.577890 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:53.577921 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:53.578347 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.578360 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.579449 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.579453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.580938 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:53.580951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.582142 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.582149 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:53.582317 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.582347 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 22:58:53.582465 (+ 118us) client_negotiation.cc:240] Negotiation successful
0805 22:58:53.582591 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"mutex_wait_us":1,"thread_start_us":509,"threads_started":1}
I20260805 22:58:53.584327 15696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999d414c52324567906b885b6590aa59" candidate_uuid: "250e177fea3149cf859b507474d06451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" is_pre_election: true
I20260805 22:58:53.584472 15306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999d414c52324567906b885b6590aa59" candidate_uuid: "250e177fea3149cf859b507474d06451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" is_pre_election: true
I20260805 22:58:53.585026 15696 raft_consensus.cc:2454] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 250e177fea3149cf859b507474d06451 in term 0.
I20260805 22:58:53.585067 15306 raft_consensus.cc:2454] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 250e177fea3149cf859b507474d06451 in term 0.
I20260805 22:58:53.585731 15400 leader_election.cc:302] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 250e177fea3149cf859b507474d06451, d1c5e83b315e46bab4ccbfbecf69fd22; no voters:
I20260805 22:58:53.586129 15795 raft_consensus.cc:2781] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:58:53.586308 15795 raft_consensus.cc:482] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:58:53.586447 15795 raft_consensus.cc:3037] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:53.589047 15795 raft_consensus.cc:504] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.589820 15795 leader_election.cc:288] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [CANDIDATE]: Term 1 election: Requested vote from peers d1c5e83b315e46bab4ccbfbecf69fd22 (127.20.34.67:35183), bf207b3f861b4dd2b0acbd423ccf707d (127.20.34.65:45595)
I20260805 22:58:53.590416 15696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999d414c52324567906b885b6590aa59" candidate_uuid: "250e177fea3149cf859b507474d06451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22"
I20260805 22:58:53.590481 15306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999d414c52324567906b885b6590aa59" candidate_uuid: "250e177fea3149cf859b507474d06451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf207b3f861b4dd2b0acbd423ccf707d"
I20260805 22:58:53.590668 15696 raft_consensus.cc:3037] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:53.590695 15306 raft_consensus.cc:3037] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:53.593179 15306 raft_consensus.cc:2454] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 250e177fea3149cf859b507474d06451 in term 1.
I20260805 22:58:53.593634 15400 leader_election.cc:302] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 250e177fea3149cf859b507474d06451, bf207b3f861b4dd2b0acbd423ccf707d; no voters:
I20260805 22:58:53.593580 15696 raft_consensus.cc:2454] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 250e177fea3149cf859b507474d06451 in term 1.
I20260805 22:58:53.593947 15795 raft_consensus.cc:2781] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:53.594501 15795 raft_consensus.cc:686] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 1 LEADER]: Becoming Leader. State: Replica: 250e177fea3149cf859b507474d06451, State: Running, Role: LEADER
I20260805 22:58:53.595129 15795 consensus_queue.cc:237] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } }
I20260805 22:58:53.600392 15093 catalog_manager.cc:5495] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 reported cstate change: term changed from 0 to 1, leader changed from <none> to 250e177fea3149cf859b507474d06451 (127.20.34.66). New cstate: current_term: 1 leader_uuid: "250e177fea3149cf859b507474d06451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "250e177fea3149cf859b507474d06451" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 38619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260805 22:58:53.627616 15781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.621680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52532 (local address 127.20.34.66:38619)
0805 22:58:53.621932 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.621941 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.621963 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:58:53.622078 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.622082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.622165 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.622331 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:58:53.622848 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.623577 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.625105 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.625538 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.625682 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.626345 (+ 663us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:58:53.626935 (+ 590us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:58:53.627126 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.627294 (+ 168us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.627346 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 22:58:53.637108 15696 raft_consensus.cc:1261] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 1 FOLLOWER]: Refusing update from remote peer 250e177fea3149cf859b507474d06451: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:53.637108 15306 raft_consensus.cc:1261] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 1 FOLLOWER]: Refusing update from remote peer 250e177fea3149cf859b507474d06451: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:53.638266 15795 consensus_queue.cc:1035] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf207b3f861b4dd2b0acbd423ccf707d" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:53.638667 15807 consensus_queue.cc:1035] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c5e83b315e46bab4ccbfbecf69fd22" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 35183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:58:53.640839 15373 tablet.cc:2369] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:58:53.667281 15092 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:53.667608 15092 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:53.672047 15092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fbb92a3ab36452e85a8625b66c5a835: Sending DeleteTablet for 3 replicas of tablet 999d414c52324567906b885b6590aa59
I20260805 22:58:53.673744 15668 tablet_service.cc:1514] Processing DeleteTablet for tablet 999d414c52324567906b885b6590aa59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:53 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:54096
I20260805 22:58:53.673745 15464 tablet_service.cc:1514] Processing DeleteTablet for tablet 999d414c52324567906b885b6590aa59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:53 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:52528
I20260805 22:58:53.673743 15276 tablet_service.cc:1514] Processing DeleteTablet for tablet 999d414c52324567906b885b6590aa59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:53 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:59940
I20260805 22:58:53.679401 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 15182
I20260805 22:58:53.709355 15824 tablet_replica.cc:330] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: stopping tablet replica
I20260805 22:58:53.709607 15825 tablet_replica.cc:330] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: stopping tablet replica
I20260805 22:58:53.709965 15824 raft_consensus.cc:2229] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:53.710005 15825 raft_consensus.cc:2229] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:53.710564 15824 raft_consensus.cc:2258] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:53.710564 15825 raft_consensus.cc:2258] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:53.711673 15828 tablet_replica.cc:330] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: stopping tablet replica
I20260805 22:58:53.712240 15828 raft_consensus.cc:2229] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:58:53.713305 15825 ts_tablet_manager.cc:1905] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:53.713491 15828 raft_consensus.cc:2258] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:53.714920 15824 ts_tablet_manager.cc:1905] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:53.715546 15828 ts_tablet_manager.cc:1905] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 05 22:58:53 dist-test-slave-gmjp krb5kdc[15031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:58:53.721390 15825 ts_tablet_manager.cc:1918] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:53.721722 15825 log.cc:1196] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/999d414c52324567906b885b6590aa59
I20260805 22:58:53.722429 15825 ts_tablet_manager.cc:1939] T 999d414c52324567906b885b6590aa59 P d1c5e83b315e46bab4ccbfbecf69fd22: Deleting consensus metadata
I20260805 22:58:53.724408 15828 ts_tablet_manager.cc:1918] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:53.724699 15828 log.cc:1196] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/999d414c52324567906b885b6590aa59
I20260805 22:58:53.724758 15074 catalog_manager.cc:4841] TS d1c5e83b315e46bab4ccbfbecf69fd22 (127.20.34.67:35183): tablet 999d414c52324567906b885b6590aa59 (table test-table [id=2063161e9ba04f09a971c5675ce998b0]) successfully deleted
I20260805 22:58:53.725728 15828 ts_tablet_manager.cc:1939] T 999d414c52324567906b885b6590aa59 P 250e177fea3149cf859b507474d06451: Deleting consensus metadata
I20260805 22:58:53.727694 15074 catalog_manager.cc:4841] TS 250e177fea3149cf859b507474d06451 (127.20.34.66:38619): tablet 999d414c52324567906b885b6590aa59 (table test-table [id=2063161e9ba04f09a971c5675ce998b0]) successfully deleted
I20260805 22:58:53.730970 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.681647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59950 (local address 127.20.34.65:45595)
0805 22:58:53.681909 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.681918 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.699734 (+ 17816us) server_negotiation.cc:407] Connection header received
0805 22:58:53.700472 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.700482 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.700608 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.700713 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:53.703709 (+ 2996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.705480 (+ 1771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.711121 (+ 5641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.711866 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.712007 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.722822 (+ 10815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:53.722846 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:53.722868 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:53.722930 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:53.727113 (+ 4183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:53.728255 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:53.728268 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:53.728275 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:53.728484 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:53.729004 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:53.729010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:53.729013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:53.729531 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:53.729867 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.730265 (+ 398us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.730549 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260805 22:58:53.732057 15365 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:53.833143 15824 ts_tablet_manager.cc:1918] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:53.833451 15824 log.cc:1196] T 999d414c52324567906b885b6590aa59 P bf207b3f861b4dd2b0acbd423ccf707d: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/999d414c52324567906b885b6590aa59
I20260805 22:58:53.833879 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 15182
I20260805 22:58:53.869480 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 15380
W20260805 22:58:53.869510 15074 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.34.65:45595 (error 108)
I20260805 22:58:53.872726 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.872139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:59958)
0805 22:58:53.872391 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.872539 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260805 22:58:53.873015 15074 catalog_manager.cc:4584] TS bf207b3f861b4dd2b0acbd423ccf707d (127.20.34.65:45595): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 999d414c52324567906b885b6590aa59: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Aug 05 22:58:53 dist-test-slave-gmjp krb5kdc[15031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:58:53.890452 15781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.870524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52544 (local address 127.20.34.66:38619)
0805 22:58:53.871227 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:53.871234 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:53.871255 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:58:53.871325 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:53.871333 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:53.871412 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:53.871544 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:53.873725 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.875036 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.876850 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:53.877599 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:53.877737 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:53.882806 (+ 5069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:53.882828 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:53.882857 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:53.882907 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:53.887239 (+ 4332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:53.888043 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:53.888054 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:53.888058 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:53.888274 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:53.888715 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:53.888720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:53.888724 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:53.889239 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:53.889614 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:53.889792 (+ 178us) server_negotiation.cc:299] Negotiation successful
0805 22:58:53.890047 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526}
I20260805 22:58:53.891371 15555 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:53.926827 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.926319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:59960)
0805 22:58:53.926551 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.926664 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260805 22:58:53.927932 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.927559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:59974)
0805 22:58:53.927720 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.927805 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260805 22:58:53.988467 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.987914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:59978)
0805 22:58:53.988134 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.988281 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260805 22:58:53.989513 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:53.989174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:59986)
0805 22:58:53.989332 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:53.989406 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260805 22:58:54.013430 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 15380
I20260805 22:58:54.040417 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 15574
Aug 05 22:58:54 dist-test-slave-gmjp krb5kdc[15031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:58:54.056620 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:54.041194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54098 (local address 127.20.34.67:35183)
0805 22:58:54.041367 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:54.041371 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:54.041433 (+ 62us) server_negotiation.cc:407] Connection header received
0805 22:58:54.041604 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:54.041608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:54.041673 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:54.041760 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:54.043154 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:54.043868 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:54.045306 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:54.045697 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:54.045789 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:54.050598 (+ 4809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:54.050613 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:54.050631 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:54.050666 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:54.053672 (+ 3006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:54.054415 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:54.054423 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:54.054426 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:54.054574 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:54.055047 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:54.055051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:54.055054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:54.055456 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:54.055715 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:54.056057 (+ 342us) server_negotiation.cc:299] Negotiation successful
0805 22:58:54.056332 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 22:58:54.057387 15755 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:54.070595 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:54.070068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:59990)
0805 22:58:54.070311 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:54.070405 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260805 22:58:54.071746 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:54.071326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:60000)
0805 22:58:54.071545 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:54.071622 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260805 22:58:54.149755 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 15574
I20260805 22:58:54.174017 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 15048
I20260805 22:58:54.175252 15129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:54.290009 15782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:54.289430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:45595 (local address 127.0.0.1:60010)
0805 22:58:54.289684 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:54.289793 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:45595: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260805 22:58:54.290134 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 15048
2026-08-05T22:58:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5063 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-05T22:58:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:58:54Z Disabled control of system clock
I20260805 22:58:54.396894 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34905
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:34905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:58:54.761942 15840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:54.762271 15840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:54.762354 15840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:54.769902 15840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:58:54.770040 15840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:54.770079 15840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:54.770131 15840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:58:54.770181 15840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:58:54.779855 15840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:34905
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:54.781352 15840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:54.783214 15840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:54.796051 15847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:54.796087 15851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:54.796052 15849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:54.797228 15840 server_base.cc:1034] running on GCE node
I20260805 22:58:54.798210 15840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:54.799858 15840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:54.801128 15840 hybrid_clock.cc:648] HybridClock initialized: now 1785970734801049 us; error 87 us; skew 500 ppm
I20260805 22:58:54.801659 15840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:58:54.804482 15840 webserver.cc:460] Webserver started at http://127.20.34.126:45561/ using document root <none> and password file <none>
I20260805 22:58:54.805305 15840 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:54.805464 15840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:54.805860 15840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:54.809990 15840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "6f1e6b0da6b7402c943e648dd7dd17f1"
format_stamp: "Formatted at 2026-08-05 22:58:54 on dist-test-slave-gmjp"
server_key: "2233e53bfd788ca0ef3562f1d4211784"
server_key_iv: "c15cd30f7c81f95f0260fe2496fce253"
server_key_version: "encryptionkey@0"
I20260805 22:58:54.811012 15840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "6f1e6b0da6b7402c943e648dd7dd17f1"
format_stamp: "Formatted at 2026-08-05 22:58:54 on dist-test-slave-gmjp"
server_key: "2233e53bfd788ca0ef3562f1d4211784"
server_key_iv: "c15cd30f7c81f95f0260fe2496fce253"
server_key_version: "encryptionkey@0"
I20260805 22:58:54.817404 15840 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 22:58:54.821389 15859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:54.823020 15840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:58:54.823264 15840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "6f1e6b0da6b7402c943e648dd7dd17f1"
format_stamp: "Formatted at 2026-08-05 22:58:54 on dist-test-slave-gmjp"
server_key: "2233e53bfd788ca0ef3562f1d4211784"
server_key_iv: "c15cd30f7c81f95f0260fe2496fce253"
server_key_version: "encryptionkey@0"
I20260805 22:58:54.823535 15840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:54.843956 15840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:54.844987 15840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:54.845328 15840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:54.865808 15840 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:34905
I20260805 22:58:54.865854 15935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:34905 every 8 connection(s)
I20260805 22:58:54.867301 15840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:58:54.871606 15936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:54.873359 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 15840
I20260805 22:58:54.873582 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:58:54.874046 20617 external_mini_cluster.cc:1428] Setting key 0819cf11d752a68ac51f48dbfe0b3dae
I20260805 22:58:54.889093 15936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1: Bootstrap starting.
I20260805 22:58:54.890997 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:54.876240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58656 (local address 127.20.34.126:34905)
0805 22:58:54.877533 (+ 1293us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:54.877566 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:54.877629 (+ 63us) server_negotiation.cc:407] Connection header received
0805 22:58:54.879764 (+ 2135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:54.879798 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:54.880575 (+ 777us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:54.881101 (+ 526us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:54.881704 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:54.883778 (+ 2074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:54.885357 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:54.886613 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:54.886801 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:54.888033 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:54.888046 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:54.888068 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:54.888930 (+ 862us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:54.889047 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:54.889087 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:54.889221 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:54.889579 (+ 358us) server_negotiation.cc:299] Negotiation successful
0805 22:58:54.889975 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":392,"threads_started":1}
I20260805 22:58:54.893180 15936 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:54.894629 15936 log.cc:824] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:54.898098 15936 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1: No bootstrap required, opened a new log
I20260805 22:58:54.907289 15936 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1e6b0da6b7402c943e648dd7dd17f1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34905 } }
I20260805 22:58:54.907744 15936 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:54.907836 15936 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1e6b0da6b7402c943e648dd7dd17f1, State: Initialized, Role: FOLLOWER
I20260805 22:58:54.908524 15936 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1e6b0da6b7402c943e648dd7dd17f1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34905 } }
I20260805 22:58:54.908777 15936 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:58:54.908893 15936 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:58:54.909040 15936 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:54.911486 15936 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1e6b0da6b7402c943e648dd7dd17f1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34905 } }
I20260805 22:58:54.912027 15936 leader_election.cc:302] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f1e6b0da6b7402c943e648dd7dd17f1; no voters:
I20260805 22:58:54.912714 15936 leader_election.cc:288] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:58:54.912905 15950 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:54.913740 15950 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6f1e6b0da6b7402c943e648dd7dd17f1, State: Running, Role: LEADER
I20260805 22:58:54.914356 15950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1e6b0da6b7402c943e648dd7dd17f1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34905 } }
I20260805 22:58:54.915221 15936 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:58:54.917470 15952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f1e6b0da6b7402c943e648dd7dd17f1. Latest consensus state: current_term: 1 leader_uuid: "6f1e6b0da6b7402c943e648dd7dd17f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1e6b0da6b7402c943e648dd7dd17f1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34905 } } }
I20260805 22:58:54.917562 15951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f1e6b0da6b7402c943e648dd7dd17f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1e6b0da6b7402c943e648dd7dd17f1" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34905 } } }
I20260805 22:58:54.917932 15952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:54.918007 15951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:54.920732 15955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:58:54.927047 15955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:58:54.937639 15955 catalog_manager.cc:1347] Generated new cluster ID: 695754700449497793acd74747f3dafd
I20260805 22:58:54.937799 15955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:58:54.946784 15955 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:58:54.948195 15955 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:58:54.963168 15955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1: Generated new TSK 0
I20260805 22:58:54.964202 15955 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:58:54.975553 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34905
--builtin_ntp_servers=127.20.34.84:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:58:55.367286 15973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:55.367610 15973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:55.367790 15973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:55.375275 15973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:55.375425 15973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:55.375634 15973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:58:55.385317 15973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:55.386781 15973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:55.389369 15973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:55.403945 15982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:55.403908 15984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:55.404181 15986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:55.405279 15973 server_base.cc:1034] running on GCE node
I20260805 22:58:55.406160 15973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:55.407471 15973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:55.408743 15973 hybrid_clock.cc:648] HybridClock initialized: now 1785970735408680 us; error 42 us; skew 500 ppm
I20260805 22:58:55.409135 15973 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:58:55.411873 15973 webserver.cc:460] Webserver started at http://127.20.34.65:36679/ using document root <none> and password file <none>
I20260805 22:58:55.412734 15973 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:55.412884 15973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:55.413254 15973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:55.416687 15973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "511aea2fa2b54c909b20f2f33f06afae"
format_stamp: "Formatted at 2026-08-05 22:58:55 on dist-test-slave-gmjp"
server_key: "e66d0f5289d5dde15d5daa4fefa8738b"
server_key_iv: "39c45d05b264212d4d9a60674508122c"
server_key_version: "encryptionkey@0"
I20260805 22:58:55.417601 15973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "511aea2fa2b54c909b20f2f33f06afae"
format_stamp: "Formatted at 2026-08-05 22:58:55 on dist-test-slave-gmjp"
server_key: "e66d0f5289d5dde15d5daa4fefa8738b"
server_key_iv: "39c45d05b264212d4d9a60674508122c"
server_key_version: "encryptionkey@0"
I20260805 22:58:55.423856 15973 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 22:58:55.428294 15993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:55.429955 15973 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260805 22:58:55.430182 15973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "511aea2fa2b54c909b20f2f33f06afae"
format_stamp: "Formatted at 2026-08-05 22:58:55 on dist-test-slave-gmjp"
server_key: "e66d0f5289d5dde15d5daa4fefa8738b"
server_key_iv: "39c45d05b264212d4d9a60674508122c"
server_key_version: "encryptionkey@0"
I20260805 22:58:55.430459 15973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:55.445447 15973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:55.446391 15973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:55.446723 15973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:55.447773 15973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:55.449404 15973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:55.449536 15973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:55.449669 15973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:55.449767 15973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:55.485129 15973 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:35233
I20260805 22:58:55.485224 16154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:35233 every 8 connection(s)
I20260805 22:58:55.486572 15973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:58:55.489401 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 15973
I20260805 22:58:55.489609 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:58:55.490162 20617 external_mini_cluster.cc:1428] Setting key cc472578a3fff7cb77778065c58259a1
I20260805 22:58:55.493171 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34905
--builtin_ntp_servers=127.20.34.84:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:58:55.501418 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:55.489495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:59123 (local address 127.20.34.126:34905)
0805 22:58:55.490085 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:55.490091 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:55.491633 (+ 1542us) server_negotiation.cc:407] Connection header received
0805 22:58:55.493652 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:55.493661 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:55.493759 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:55.493883 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:55.495027 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:55.496260 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:55.497908 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:55.498655 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:55.498811 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:55.500294 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:55.500303 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:55.500311 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:55.500342 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:55.500399 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:55.500420 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:55.500526 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:55.500822 (+ 296us) server_negotiation.cc:299] Negotiation successful
0805 22:58:55.500951 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":298,"threads_started":1}
I20260805 22:58:55.502813 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:55.490252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34905 (local address 127.20.34.65:59123)
0805 22:58:55.491438 (+ 1186us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:55.491497 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:55.493292 (+ 1795us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:55.494107 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:55.494116 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:55.494213 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:55.494841 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:55.494862 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:55.496444 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:55.496448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:55.497753 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:55.497766 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:55.498891 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:55.498896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:55.499110 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:55.499903 (+ 793us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:58:55.499906 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:55.499950 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:58:55.500037 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:55.500545 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:55.500558 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:55.500567 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 22:58:55.500791 (+ 224us) client_negotiation.cc:240] Negotiation successful
0805 22:58:55.501252 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":365,"threads_started":1}
I20260805 22:58:55.504722 16156 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34905
I20260805 22:58:55.505086 16156 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:55.505990 16156 heartbeater.cc:511] Master 127.20.34.126:34905 requested a full tablet report, sending...
I20260805 22:58:55.508482 15886 ts_manager.cc:194] Registered new tserver with Master: 511aea2fa2b54c909b20f2f33f06afae (127.20.34.65:35233)
I20260805 22:58:55.510236 15886 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.65:59123
W20260805 22:58:55.862056 16163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:55.862385 16163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:55.862479 16163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:55.870065 16163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:55.870223 16163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:55.870414 16163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:58:55.880388 16163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:55.881778 16163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:55.883697 16163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:55.898013 16171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:55.897965 16174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:55.897920 16179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:55.898931 16163 server_base.cc:1034] running on GCE node
I20260805 22:58:55.899602 16163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:55.900673 16163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:55.901917 16163 hybrid_clock.cc:648] HybridClock initialized: now 1785970735901864 us; error 48 us; skew 500 ppm
I20260805 22:58:55.902257 16163 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:58:55.904726 16163 webserver.cc:460] Webserver started at http://127.20.34.66:32817/ using document root <none> and password file <none>
I20260805 22:58:55.905481 16163 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:55.905623 16163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:55.905965 16163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:55.909170 16163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "045be6b4ef404586a0abad5d91dc79cb"
format_stamp: "Formatted at 2026-08-05 22:58:55 on dist-test-slave-gmjp"
server_key: "dd03a60dd8e0f35a9d3cfc0a7f26540b"
server_key_iv: "49f45a4ec1f22c1ea0d2b7b92206d2fd"
server_key_version: "encryptionkey@0"
I20260805 22:58:55.910044 16163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "045be6b4ef404586a0abad5d91dc79cb"
format_stamp: "Formatted at 2026-08-05 22:58:55 on dist-test-slave-gmjp"
server_key: "dd03a60dd8e0f35a9d3cfc0a7f26540b"
server_key_iv: "49f45a4ec1f22c1ea0d2b7b92206d2fd"
server_key_version: "encryptionkey@0"
I20260805 22:58:55.915580 16163 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260805 22:58:55.919575 16185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:55.921317 16163 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260805 22:58:55.921521 16163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "045be6b4ef404586a0abad5d91dc79cb"
format_stamp: "Formatted at 2026-08-05 22:58:55 on dist-test-slave-gmjp"
server_key: "dd03a60dd8e0f35a9d3cfc0a7f26540b"
server_key_iv: "49f45a4ec1f22c1ea0d2b7b92206d2fd"
server_key_version: "encryptionkey@0"
I20260805 22:58:55.921765 16163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:55.936373 16163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:55.937258 16163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:55.937584 16163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:55.938638 16163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:55.940362 16163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:55.940482 16163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:55.940618 16163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:55.940714 16163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:55.975802 16163 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:46341
I20260805 22:58:55.975910 16357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:46341 every 8 connection(s)
I20260805 22:58:55.977653 16163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:58:55.982789 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 16163
I20260805 22:58:55.983000 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:58:55.983449 20617 external_mini_cluster.cc:1428] Setting key f7298c27f2cad970b716d620550c7e21
I20260805 22:58:55.987063 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34905
--builtin_ntp_servers=127.20.34.84:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:58:55.992360 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:55.980594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:35497 (local address 127.20.34.126:34905)
0805 22:58:55.980839 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:55.980846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:55.982351 (+ 1505us) server_negotiation.cc:407] Connection header received
0805 22:58:55.984390 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:55.984402 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:55.984491 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:55.984606 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:55.985953 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:55.987105 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:55.988904 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:55.989656 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:55.989813 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:55.991313 (+ 1500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:55.991322 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:55.991330 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:55.991361 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:55.991408 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:55.991427 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:55.991525 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:55.991744 (+ 219us) server_negotiation.cc:299] Negotiation successful
0805 22:58:55.991868 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 22:58:55.993376 16362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:55.981155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34905 (local address 127.20.34.66:35497)
0805 22:58:55.982156 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:55.982203 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:55.984040 (+ 1837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:55.984914 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:55.984926 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:55.985048 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:55.985775 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:55.985794 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:55.987306 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:55.987314 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:55.988741 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:55.988755 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:55.989903 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:55.989908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:55.990121 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:55.990941 (+ 820us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:58:55.990944 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:55.990990 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:58:55.991082 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:55.991532 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:55.991540 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:55.991546 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:58:55.991699 (+ 153us) client_negotiation.cc:240] Negotiation successful
0805 22:58:55.992054 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":306,"threads_started":1}
I20260805 22:58:55.995014 16358 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34905
I20260805 22:58:55.995396 16358 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:55.996515 16358 heartbeater.cc:511] Master 127.20.34.126:34905 requested a full tablet report, sending...
I20260805 22:58:55.998272 15886 ts_manager.cc:194] Registered new tserver with Master: 045be6b4ef404586a0abad5d91dc79cb (127.20.34.66:46341)
I20260805 22:58:55.999138 15886 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.66:35497
W20260805 22:58:56.371062 16363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:56.371388 16363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:56.371477 16363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:56.379083 16363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:56.379207 16363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:56.379321 16363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:58:56.388816 16363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:34905
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:56.390236 16363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:56.392082 16363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:56.404976 16369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:56.406914 16370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:56.407088 16372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:56.407765 16363 server_base.cc:1034] running on GCE node
I20260805 22:58:56.408563 16363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:56.409646 16363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:56.410907 16363 hybrid_clock.cc:648] HybridClock initialized: now 1785970736410841 us; error 64 us; skew 500 ppm
I20260805 22:58:56.411245 16363 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:58:56.413769 16363 webserver.cc:460] Webserver started at http://127.20.34.67:38451/ using document root <none> and password file <none>
I20260805 22:58:56.414618 16363 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:56.414755 16363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:56.415150 16363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:56.418370 16363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "90db4f85845348438e5b3cbf7e46a679"
format_stamp: "Formatted at 2026-08-05 22:58:56 on dist-test-slave-gmjp"
server_key: "5eb2b449588fd146a257ad12b4c23d08"
server_key_iv: "c34e1e2de30e4fb431cab0bd79085f43"
server_key_version: "encryptionkey@0"
I20260805 22:58:56.419240 16363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "90db4f85845348438e5b3cbf7e46a679"
format_stamp: "Formatted at 2026-08-05 22:58:56 on dist-test-slave-gmjp"
server_key: "5eb2b449588fd146a257ad12b4c23d08"
server_key_iv: "c34e1e2de30e4fb431cab0bd79085f43"
server_key_version: "encryptionkey@0"
I20260805 22:58:56.425185 16363 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260805 22:58:56.429425 16382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:56.431021 16363 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:58:56.431334 16363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "90db4f85845348438e5b3cbf7e46a679"
format_stamp: "Formatted at 2026-08-05 22:58:56 on dist-test-slave-gmjp"
server_key: "5eb2b449588fd146a257ad12b4c23d08"
server_key_iv: "c34e1e2de30e4fb431cab0bd79085f43"
server_key_version: "encryptionkey@0"
I20260805 22:58:56.431581 16363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:56.460541 16363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:56.461508 16363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:56.461858 16363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:56.462989 16363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:58:56.464614 16363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:58:56.464757 16363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:56.464890 16363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:58:56.464985 16363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:56.511514 16363 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:42845
I20260805 22:58:56.511606 16538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:42845 every 8 connection(s)
I20260805 22:58:56.513010 16363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:58:56.513852 16156 heartbeater.cc:503] Master 127.20.34.126:34905 was elected leader, sending a full tablet report...
I20260805 22:58:56.516611 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 16363
I20260805 22:58:56.516831 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:58:56.517429 20617 external_mini_cluster.cc:1428] Setting key 74989e6372a5fb6c887d87389ee81722
I20260805 22:58:56.528393 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.516401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:55301 (local address 127.20.34.126:34905)
0805 22:58:56.519390 (+ 2989us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.519397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.519419 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:58:56.521534 (+ 2115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.521540 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.521634 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.521789 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:56.522903 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.523686 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.525321 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.525800 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.525938 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.527451 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:56.527456 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:56.527459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:56.527479 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:56.527534 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:56.527547 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:56.527647 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.527881 (+ 234us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.527985 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2845,"thread_start_us":2736,"threads_started":1}
I20260805 22:58:56.529455 16542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.517225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34905 (local address 127.20.34.67:55301)
0805 22:58:56.518912 (+ 1687us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:56.518962 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:56.521263 (+ 2301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:56.522023 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:56.522031 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:56.522132 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:58:56.522730 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.522749 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.523853 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.523858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.525164 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.525176 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.526039 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.526047 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.526285 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.527096 (+ 811us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:58:56.527098 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:58:56.527139 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:58:56.527226 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:58:56.527649 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:58:56.527664 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:58:56.527674 (+ 10us) client_negotiation.cc:769] Sending connection context
0805 22:58:56.527869 (+ 195us) client_negotiation.cc:240] Negotiation successful
0805 22:58:56.528359 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1072,"thread_start_us":823,"threads_started":1}
I20260805 22:58:56.530969 16539 heartbeater.cc:347] Connected to a master server at 127.20.34.126:34905
I20260805 22:58:56.531324 16539 heartbeater.cc:464] Registering TS with master...
I20260805 22:58:56.532352 16539 heartbeater.cc:511] Master 127.20.34.126:34905 requested a full tablet report, sending...
I20260805 22:58:56.534073 15886 ts_manager.cc:194] Registered new tserver with Master: 90db4f85845348438e5b3cbf7e46a679 (127.20.34.67:42845)
I20260805 22:58:56.535028 15886 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.67:55301
I20260805 22:58:56.546397 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:58:56.556622 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.550552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58664 (local address 127.20.34.126:34905)
0805 22:58:56.550804 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.550814 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.551195 (+ 381us) server_negotiation.cc:407] Connection header received
0805 22:58:56.551333 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.551338 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.551405 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.551490 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:56.552005 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.552750 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.554136 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.554533 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.554627 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.555752 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:56.555757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:56.555760 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:56.555779 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:56.555813 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:56.555824 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:56.555966 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.556132 (+ 166us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.556265 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:58:56.560587 15886 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:58:56.567431 15886 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:58:56.594995 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.581622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56820 (local address 127.20.34.65:35233)
0805 22:58:56.586701 (+ 5079us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.586711 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.586744 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:58:56.586845 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.586853 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.587111 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.587377 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:56.588012 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.589763 (+ 1751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.592556 (+ 2793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.593865 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.594040 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.594355 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.594450 (+ 95us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.594622 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4887,"thread_start_us":4745,"threads_started":1}
I20260805 22:58:56.595024 16557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.581350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56820)
0805 22:58:56.583465 (+ 2115us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:56.583487 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:56.583619 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:56.587376 (+ 3757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:56.587382 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:56.587411 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:56.587749 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.587762 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.589930 (+ 2168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.589935 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.592041 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.592053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.594076 (+ 2023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.594082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.594265 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.594299 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:58:56.594384 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 22:58:56.594605 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1963,"mutex_wait_us":47,"thread_start_us":596,"threads_started":1}
I20260805 22:58:56.595630 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.582999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:46341 (local address 127.0.0.1:55906)
0805 22:58:56.586038 (+ 3039us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:56.586054 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:56.586148 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:56.588047 (+ 1899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:56.588051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:56.588082 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:56.588613 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.588627 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.590551 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.590556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.592533 (+ 1977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.592549 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.594713 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.594720 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.594911 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.594941 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 22:58:56.595029 (+ 88us) client_negotiation.cc:240] Negotiation successful
0805 22:58:56.595285 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2923,"mutex_wait_us":33,"thread_start_us":2775,"threads_started":1}
I20260805 22:58:56.595999 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.580794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:42845 (local address 127.0.0.1:37926)
0805 22:58:56.582517 (+ 1723us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:56.582571 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:56.582812 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:56.586602 (+ 3790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:56.586610 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:56.586644 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:56.587113 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.587127 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.589170 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.589174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.591446 (+ 2272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.591462 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.593962 (+ 2500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.593968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.594171 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.594233 (+ 62us) client_negotiation.cc:769] Sending connection context
0805 22:58:56.594368 (+ 135us) client_negotiation.cc:240] Negotiation successful
0805 22:58:56.595574 (+ 1206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1327,"mutex_wait_us":1018,"thread_start_us":2373,"threads_started":1}
I20260805 22:58:56.596339 16558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.581074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37926 (local address 127.20.34.67:42845)
0805 22:58:56.585749 (+ 4675us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.585773 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.585817 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:58:56.585948 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.585961 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.586294 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.586557 (+ 263us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:56.587358 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.588997 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.591679 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.593246 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.593392 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.594686 (+ 1294us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.594765 (+ 79us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.594937 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4452,"thread_start_us":4269,"threads_started":1}
I20260805 22:58:56.596632 16565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.583229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55906 (local address 127.20.34.66:46341)
0805 22:58:56.587377 (+ 4148us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.587385 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.587412 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:58:56.587512 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.587519 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.587827 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.588831 (+ 1004us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:56.589113 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.590397 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.592765 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.594199 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.594351 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.594573 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.596044 (+ 1471us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.596280 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3977,"thread_start_us":3853,"threads_started":1}
I20260805 22:58:56.599653 16062 tablet_service.cc:1467] Processing CreateTablet for tablet 6228980ce1da4a0c8adc0c5396082d4c (DEFAULT_TABLE table=test-table [id=18363b0ab9664fba8499f63816be82c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:56.600108 16453 tablet_service.cc:1467] Processing CreateTablet for tablet 6228980ce1da4a0c8adc0c5396082d4c (DEFAULT_TABLE table=test-table [id=18363b0ab9664fba8499f63816be82c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:56.600283 16266 tablet_service.cc:1467] Processing CreateTablet for tablet 6228980ce1da4a0c8adc0c5396082d4c (DEFAULT_TABLE table=test-table [id=18363b0ab9664fba8499f63816be82c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:58:56.601330 16062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6228980ce1da4a0c8adc0c5396082d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:56.601579 16453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6228980ce1da4a0c8adc0c5396082d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:56.601723 16266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6228980ce1da4a0c8adc0c5396082d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:56.614352 16566 tablet_bootstrap.cc:492] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: Bootstrap starting.
I20260805 22:58:56.616868 16570 tablet_bootstrap.cc:492] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae: Bootstrap starting.
I20260805 22:58:56.618804 16566 tablet_bootstrap.cc:654] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:56.619798 16569 tablet_bootstrap.cc:492] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: Bootstrap starting.
I20260805 22:58:56.620256 16566 log.cc:824] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:56.621510 16570 tablet_bootstrap.cc:654] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:56.622851 16570 log.cc:824] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:56.624082 16566 tablet_bootstrap.cc:492] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: No bootstrap required, opened a new log
I20260805 22:58:56.624450 16566 ts_tablet_manager.cc:1397] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260805 22:58:56.624877 16569 tablet_bootstrap.cc:654] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:56.626219 16569 log.cc:824] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:56.626642 16570 tablet_bootstrap.cc:492] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae: No bootstrap required, opened a new log
I20260805 22:58:56.627007 16570 ts_tablet_manager.cc:1397] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260805 22:58:56.629878 16569 tablet_bootstrap.cc:492] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: No bootstrap required, opened a new log
I20260805 22:58:56.630173 16569 ts_tablet_manager.cc:1397] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.006s
I20260805 22:58:56.633486 16566 raft_consensus.cc:348] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.634068 16566 raft_consensus.cc:374] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:56.634176 16566 raft_consensus.cc:729] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045be6b4ef404586a0abad5d91dc79cb, State: Initialized, Role: FOLLOWER
I20260805 22:58:56.634917 16566 consensus_queue.cc:260] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.636289 16358 heartbeater.cc:503] Master 127.20.34.126:34905 was elected leader, sending a full tablet report...
I20260805 22:58:56.636978 16566 ts_tablet_manager.cc:1428] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: Time spent starting tablet: real 0.012s user 0.006s sys 0.006s
I20260805 22:58:56.640430 16570 raft_consensus.cc:348] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.640955 16570 raft_consensus.cc:374] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:56.641070 16570 raft_consensus.cc:729] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 511aea2fa2b54c909b20f2f33f06afae, State: Initialized, Role: FOLLOWER
I20260805 22:58:56.641258 16569 raft_consensus.cc:348] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.641690 16569 raft_consensus.cc:374] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:56.641803 16569 raft_consensus.cc:729] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90db4f85845348438e5b3cbf7e46a679, State: Initialized, Role: FOLLOWER
I20260805 22:58:56.641891 16570 consensus_queue.cc:260] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.642583 16569 consensus_queue.cc:260] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.644170 16570 ts_tablet_manager.cc:1428] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae: Time spent starting tablet: real 0.017s user 0.016s sys 0.000s
I20260805 22:58:56.645243 16539 heartbeater.cc:503] Master 127.20.34.126:34905 was elected leader, sending a full tablet report...
I20260805 22:58:56.645917 16569 ts_tablet_manager.cc:1428] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260805 22:58:56.648063 16577 raft_consensus.cc:482] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:58:56.648439 16577 raft_consensus.cc:504] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.650156 16577 leader_election.cc:288] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 511aea2fa2b54c909b20f2f33f06afae (127.20.34.65:35233), 045be6b4ef404586a0abad5d91dc79cb (127.20.34.66:46341)
I20260805 22:58:56.657042 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.650722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:45503 (local address 127.20.34.65:35233)
0805 22:58:56.650945 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.650953 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.651174 (+ 221us) server_negotiation.cc:407] Connection header received
0805 22:58:56.651378 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.651386 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.651481 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.651579 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:56.652087 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.653112 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.654970 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.656087 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.656302 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.656364 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.656687 (+ 323us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.656791 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 22:58:56.657171 16542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.650433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.20.34.67:45503)
0805 22:58:56.651058 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:56.651082 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:56.651218 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:56.651642 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:56.651647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:56.651677 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:56.651924 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.651937 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.653251 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.653257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.654801 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.654813 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.656282 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.656289 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.656500 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.656538 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 22:58:56.656651 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 22:58:56.656806 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"spinlock_wait_cycles":11520}
I20260805 22:58:56.657809 16565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.651094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:59865 (local address 127.20.34.66:46341)
0805 22:58:56.651315 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.651321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.651714 (+ 393us) server_negotiation.cc:407] Connection header received
0805 22:58:56.651931 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.651936 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.652040 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.652128 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:58:56.652831 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.653726 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.655743 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.656851 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.657012 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.657075 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.657421 (+ 346us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.657554 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 22:58:56.657840 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.650737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:46341 (local address 127.20.34.67:59865)
0805 22:58:56.651626 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:56.651646 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:58:56.651784 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:58:56.652202 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:58:56.652208 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:58:56.652235 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:58:56.652624 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.652637 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.653909 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.653913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.655533 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:58:56.655548 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.657039 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.657046 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:58:56.657244 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.657278 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 22:58:56.657378 (+ 100us) client_negotiation.cc:240] Negotiation successful
0805 22:58:56.657514 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"thread_start_us":567,"threads_started":1}
I20260805 22:58:56.658448 16096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6228980ce1da4a0c8adc0c5396082d4c" candidate_uuid: "90db4f85845348438e5b3cbf7e46a679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511aea2fa2b54c909b20f2f33f06afae" is_pre_election: true
I20260805 22:58:56.658892 16299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6228980ce1da4a0c8adc0c5396082d4c" candidate_uuid: "90db4f85845348438e5b3cbf7e46a679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045be6b4ef404586a0abad5d91dc79cb" is_pre_election: true
I20260805 22:58:56.659191 16096 raft_consensus.cc:2454] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90db4f85845348438e5b3cbf7e46a679 in term 0.
I20260805 22:58:56.659471 16299 raft_consensus.cc:2454] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90db4f85845348438e5b3cbf7e46a679 in term 0.
I20260805 22:58:56.660040 16388 leader_election.cc:302] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511aea2fa2b54c909b20f2f33f06afae, 90db4f85845348438e5b3cbf7e46a679; no voters:
I20260805 22:58:56.660480 16577 raft_consensus.cc:2781] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:58:56.660648 16577 raft_consensus.cc:482] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:58:56.660773 16577 raft_consensus.cc:3037] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:56.663062 16577 raft_consensus.cc:504] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.663862 16577 leader_election.cc:288] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [CANDIDATE]: Term 1 election: Requested vote from peers 511aea2fa2b54c909b20f2f33f06afae (127.20.34.65:35233), 045be6b4ef404586a0abad5d91dc79cb (127.20.34.66:46341)
I20260805 22:58:56.664381 16096 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6228980ce1da4a0c8adc0c5396082d4c" candidate_uuid: "90db4f85845348438e5b3cbf7e46a679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "511aea2fa2b54c909b20f2f33f06afae"
I20260805 22:58:56.664453 16299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6228980ce1da4a0c8adc0c5396082d4c" candidate_uuid: "90db4f85845348438e5b3cbf7e46a679" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "045be6b4ef404586a0abad5d91dc79cb"
I20260805 22:58:56.664659 16096 raft_consensus.cc:3037] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:56.664721 16299 raft_consensus.cc:3037] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:56.667413 16096 raft_consensus.cc:2454] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90db4f85845348438e5b3cbf7e46a679 in term 1.
I20260805 22:58:56.667438 16299 raft_consensus.cc:2454] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90db4f85845348438e5b3cbf7e46a679 in term 1.
I20260805 22:58:56.667930 16388 leader_election.cc:302] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 511aea2fa2b54c909b20f2f33f06afae, 90db4f85845348438e5b3cbf7e46a679; no voters:
I20260805 22:58:56.668304 16577 raft_consensus.cc:2781] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:56.668869 16577 raft_consensus.cc:686] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 1 LEADER]: Becoming Leader. State: Replica: 90db4f85845348438e5b3cbf7e46a679, State: Running, Role: LEADER
I20260805 22:58:56.669394 16577 consensus_queue.cc:237] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } }
I20260805 22:58:56.674661 15885 catalog_manager.cc:5495] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90db4f85845348438e5b3cbf7e46a679 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "90db4f85845348438e5b3cbf7e46a679" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90db4f85845348438e5b3cbf7e46a679" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 42845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 } health_report { overall_health: UNKNOWN } } }
I20260805 22:58:56.697516 16558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.691366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37932 (local address 127.20.34.67:42845)
0805 22:58:56.691580 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.691588 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.691694 (+ 106us) server_negotiation.cc:407] Connection header received
0805 22:58:56.691975 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.691979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.692065 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.692294 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:58:56.692716 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.693661 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.695071 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.695493 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.695634 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.696326 (+ 692us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:58:56.696850 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:58:56.697051 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.697221 (+ 170us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.697268 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:58:56.706354 16096 raft_consensus.cc:1261] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 1 FOLLOWER]: Refusing update from remote peer 90db4f85845348438e5b3cbf7e46a679: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:56.706423 16299 raft_consensus.cc:1261] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 1 FOLLOWER]: Refusing update from remote peer 90db4f85845348438e5b3cbf7e46a679: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:58:56.707438 16579 consensus_queue.cc:1035] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "511aea2fa2b54c909b20f2f33f06afae" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 35233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:56.707800 16577 consensus_queue.cc:1035] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [LEADER]: Connected to new peer: Peer: permanent_uuid: "045be6b4ef404586a0abad5d91dc79cb" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:58:56.718631 16584 mvcc.cc:205] Tried to move back new op lower bound from 7315336137538297856 to 7315336137401901056. Current Snapshot: MvccSnapshot[applied={T|T < 7315336137538297856}]
I20260805 22:58:56.718942 16585 mvcc.cc:205] Tried to move back new op lower bound from 7315336137538297856 to 7315336137401901056. Current Snapshot: MvccSnapshot[applied={T|T < 7315336137538297856}]
I20260805 22:58:56.736377 15885 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:56.736732 15885 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:58:56.740914 15885 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f1e6b0da6b7402c943e648dd7dd17f1: Sending DeleteTablet for 3 replicas of tablet 6228980ce1da4a0c8adc0c5396082d4c
I20260805 22:58:56.742377 16266 tablet_service.cc:1514] Processing DeleteTablet for tablet 6228980ce1da4a0c8adc0c5396082d4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:56 UTC) from {username='slave'} at 127.0.0.1:55906
I20260805 22:58:56.742385 16453 tablet_service.cc:1514] Processing DeleteTablet for tablet 6228980ce1da4a0c8adc0c5396082d4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:56 UTC) from {username='slave'} at 127.0.0.1:37926
I20260805 22:58:56.743431 16598 tablet_replica.cc:330] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: stopping tablet replica
I20260805 22:58:56.743407 16062 tablet_service.cc:1514] Processing DeleteTablet for tablet 6228980ce1da4a0c8adc0c5396082d4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:58:56 UTC) from {username='slave'} at 127.0.0.1:56820
I20260805 22:58:56.743700 16600 tablet_replica.cc:330] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: stopping tablet replica
I20260805 22:58:56.744086 16598 raft_consensus.cc:2229] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:56.744104 16600 raft_consensus.cc:2229] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:58:56.744737 16598 raft_consensus.cc:2258] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:56.744858 16600 raft_consensus.cc:2258] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:56.745543 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 15973
I20260805 22:58:56.747130 16598 ts_tablet_manager.cc:1905] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:56.747138 16600 ts_tablet_manager.cc:1905] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:56.754829 16600 ts_tablet_manager.cc:1918] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:56.754835 16598 ts_tablet_manager.cc:1918] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:58:56.755069 16600 log.cc:1196] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/6228980ce1da4a0c8adc0c5396082d4c
I20260805 22:58:56.755789 16600 ts_tablet_manager.cc:1939] T 6228980ce1da4a0c8adc0c5396082d4c P 90db4f85845348438e5b3cbf7e46a679: Deleting consensus metadata
I20260805 22:58:56.756373 16598 log.cc:1196] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/6228980ce1da4a0c8adc0c5396082d4c
I20260805 22:58:56.756780 16602 tablet_replica.cc:330] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae: stopping tablet replica
I20260805 22:58:56.757220 16598 ts_tablet_manager.cc:1939] T 6228980ce1da4a0c8adc0c5396082d4c P 045be6b4ef404586a0abad5d91dc79cb: Deleting consensus metadata
I20260805 22:58:56.757372 16602 raft_consensus.cc:2229] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:58:56.758064 16602 raft_consensus.cc:2258] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:58:56.759639 15863 catalog_manager.cc:4841] TS 045be6b4ef404586a0abad5d91dc79cb (127.20.34.66:46341): tablet 6228980ce1da4a0c8adc0c5396082d4c (table test-table [id=18363b0ab9664fba8499f63816be82c7]) successfully deleted
I20260805 22:58:56.760524 16602 ts_tablet_manager.cc:1905] T 6228980ce1da4a0c8adc0c5396082d4c P 511aea2fa2b54c909b20f2f33f06afae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:58:56.762367 15861 catalog_manager.cc:4841] TS 90db4f85845348438e5b3cbf7e46a679 (127.20.34.67:42845): tablet 6228980ce1da4a0c8adc0c5396082d4c (table test-table [id=18363b0ab9664fba8499f63816be82c7]) successfully deleted
I20260805 22:58:56.765057 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.749518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56832 (local address 127.20.34.65:35233)
0805 22:58:56.749748 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.749755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.755821 (+ 6066us) server_negotiation.cc:407] Connection header received
0805 22:58:56.756263 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.756270 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.756438 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.756571 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:56.757292 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.758611 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.760748 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.761396 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.761545 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.763175 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:56.763189 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:56.763208 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:56.764069 (+ 861us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:56.764133 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:56.764211 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:56.764339 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.764513 (+ 174us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.764635 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 22:58:56.765832 16149 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:56.920126 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 15973
W20260805 22:58:56.947940 15863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.34.65:35233 (error 108)
I20260805 22:58:56.948104 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 16163
I20260805 22:58:56.950379 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.949885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56838)
0805 22:58:56.950068 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:56.950190 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260805 22:58:56.950651 15863 catalog_manager.cc:4584] TS 511aea2fa2b54c909b20f2f33f06afae (127.20.34.65:35233): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6228980ce1da4a0c8adc0c5396082d4c: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
I20260805 22:58:56.957536 16565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:56.949121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55922 (local address 127.20.34.66:46341)
0805 22:58:56.949340 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:56.949346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:56.949368 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:58:56.949574 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:56.949580 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:56.949709 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:56.949837 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:56.951019 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.952332 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.953679 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:56.954269 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:56.954416 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:56.955655 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:56.955669 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:56.955691 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:56.956554 (+ 863us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:56.956627 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:56.956656 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:56.956800 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:56.957006 (+ 206us) server_negotiation.cc:299] Negotiation successful
0805 22:58:56.957139 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:58:56.958418 16351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:57.004550 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:57.003905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56852)
0805 22:58:57.004211 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:57.004334 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260805 22:58:57.005926 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:57.005431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56860)
0805 22:58:57.005626 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:57.005743 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260805 22:58:57.060374 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 16163
I20260805 22:58:57.067116 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:57.066407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56874)
0805 22:58:57.066725 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:57.066854 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260805 22:58:57.068481 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:57.067992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56884)
0805 22:58:57.068224 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:57.068322 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260805 22:58:57.086778 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 16363
I20260805 22:58:57.094796 16558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:57.087875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37948 (local address 127.20.34.67:42845)
0805 22:58:57.088087 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:57.088094 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:57.088116 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:58:57.088545 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:57.088550 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:57.088655 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:57.088778 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:57.089274 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:57.090091 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:57.091439 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:57.091909 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:57.092067 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:57.093285 (+ 1218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:57.093295 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:57.093319 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:58:57.093970 (+ 651us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:57.094022 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:58:57.094046 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:57.094169 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:57.094327 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 22:58:57.094448 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260805 22:58:57.095639 16530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:57.149325 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:57.148780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56896)
0805 22:58:57.149034 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:57.149139 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260805 22:58:57.150777 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:57.150379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56906)
0805 22:58:57.150599 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:57.150670 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260805 22:58:57.226935 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 16363
I20260805 22:58:57.254609 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 15840
I20260805 22:58:57.255920 15931 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:58:57.368891 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:57.368352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:35233 (local address 127.0.0.1:56922)
0805 22:58:57.368559 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0805 22:58:57.368670 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:35233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260805 22:58:57.368906 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 15840
2026-08-05T22:58:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3081 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:58:57 dist-test-slave-gmjp krb5kdc[16612](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:58:57 dist-test-slave-gmjp krb5kdc[16612](info): set up 2 sockets
Aug 05 22:58:57 dist-test-slave-gmjp krb5kdc[16612](info): commencing operation
krb5kdc: starting...
W20260805 22:58:58.751469 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.000s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:58:58 dist-test-slave-gmjp krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:58:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:58:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:58:59.127885 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:33547
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:33547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:58:59.501056 16630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:58:59.501503 16630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:58:59.501678 16630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:58:59.509531 16630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:58:59.509719 16630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:58:59.509840 16630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:58:59.509950 16630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:58:59.510044 16630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:58:59.521890 16630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:33547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:33547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:58:59.523519 16630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:58:59.525084 16630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:58:59.537887 16638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:59.537847 16639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:58:59.537931 16641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:58:59.539636 16630 server_base.cc:1034] running on GCE node
I20260805 22:58:59.540678 16630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:58:59.542400 16630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:58:59.543649 16630 hybrid_clock.cc:648] HybridClock initialized: now 1785970739543588 us; error 59 us; skew 500 ppm
I20260805 22:58:59.544077 16630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:58:59 dist-test-slave-gmjp krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970739, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:58:59.551484 16630 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:58:59.553296 16630 webserver.cc:460] Webserver started at http://127.20.34.126:39509/ using document root <none> and password file <none>
I20260805 22:58:59.554127 16630 fs_manager.cc:359] Metadata directory not provided
I20260805 22:58:59.554308 16630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:58:59.554653 16630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:58:59.558136 16630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "07b377bdc7b04aa7b53e01874186f667"
format_stamp: "Formatted at 2026-08-05 22:58:59 on dist-test-slave-gmjp"
server_key: "5c6d93a5de6a41ecdf66e931caae1f04"
server_key_iv: "00c87ff812a73c8f8fade5ebe3ed6f7f"
server_key_version: "encryptionkey@0"
I20260805 22:58:59.559039 16630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "07b377bdc7b04aa7b53e01874186f667"
format_stamp: "Formatted at 2026-08-05 22:58:59 on dist-test-slave-gmjp"
server_key: "5c6d93a5de6a41ecdf66e931caae1f04"
server_key_iv: "00c87ff812a73c8f8fade5ebe3ed6f7f"
server_key_version: "encryptionkey@0"
I20260805 22:58:59.564929 16630 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:58:59.568686 16650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:58:59.570122 16630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:58:59.570339 16630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "07b377bdc7b04aa7b53e01874186f667"
format_stamp: "Formatted at 2026-08-05 22:58:59 on dist-test-slave-gmjp"
server_key: "5c6d93a5de6a41ecdf66e931caae1f04"
server_key_iv: "00c87ff812a73c8f8fade5ebe3ed6f7f"
server_key_version: "encryptionkey@0"
I20260805 22:58:59.570573 16630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:58:59.593926 16630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:58:59.598759 16630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:58:59.599095 16630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:58:59.619745 16630 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:33547
I20260805 22:58:59.619768 16726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:33547 every 8 connection(s)
I20260805 22:58:59.621392 16630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:58:59.625712 16727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:58:59.626091 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 16630
I20260805 22:58:59.626318 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:58:59.626946 20617 external_mini_cluster.cc:1428] Setting key 7647b98ff4406bc6f54cc31be084352e
I20260805 22:58:59.641038 16727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667: Bootstrap starting.
Aug 05 22:58:59 dist-test-slave-gmjp krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:58:59.645181 16727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667: Neither blocks nor log segments found. Creating new log.
I20260805 22:58:59.646318 16727 log.cc:824] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667: Log is configured to *not* fsync() on all Append() calls
I20260805 22:58:59.649497 16727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667: No bootstrap required, opened a new log
I20260805 22:58:59.653085 16730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:58:59.629132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59962 (local address 127.20.34.126:33547)
0805 22:58:59.630102 (+ 970us) server_negotiation.cc:206] Beginning negotiation
0805 22:58:59.630115 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:58:59.630159 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:58:59.632496 (+ 2337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:58:59.632523 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:58:59.632987 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:58:59.633373 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:58:59.635372 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:59.636825 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:59.638806 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:58:59.639525 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:58:59.639672 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:58:59.645050 (+ 5378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:58:59.645059 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:58:59.645079 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:58:59.645132 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:58:59.648494 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:59.649362 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:59.649370 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:59.649377 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:59.649577 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:58:59.650029 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:58:59.650034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:58:59.650038 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:58:59.650595 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:58:59.650919 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0805 22:58:59.651444 (+ 525us) server_negotiation.cc:299] Negotiation successful
0805 22:58:59.651922 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":432,"threads_started":1}
I20260805 22:58:59.658994 16727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b377bdc7b04aa7b53e01874186f667" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33547 } }
I20260805 22:58:59.659575 16727 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:58:59.659693 16727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07b377bdc7b04aa7b53e01874186f667, State: Initialized, Role: FOLLOWER
I20260805 22:58:59.660437 16727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b377bdc7b04aa7b53e01874186f667" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33547 } }
I20260805 22:58:59.660696 16727 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:58:59.660857 16727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:58:59.661044 16727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:58:59.663404 16727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b377bdc7b04aa7b53e01874186f667" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33547 } }
I20260805 22:58:59.663990 16727 leader_election.cc:302] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07b377bdc7b04aa7b53e01874186f667; no voters:
I20260805 22:58:59.664664 16727 leader_election.cc:288] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:58:59.664844 16732 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:58:59.665570 16732 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [term 1 LEADER]: Becoming Leader. State: Replica: 07b377bdc7b04aa7b53e01874186f667, State: Running, Role: LEADER
I20260805 22:58:59.666296 16732 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b377bdc7b04aa7b53e01874186f667" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33547 } }
I20260805 22:58:59.667161 16727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:58:59.669739 16733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07b377bdc7b04aa7b53e01874186f667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b377bdc7b04aa7b53e01874186f667" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33547 } } }
I20260805 22:58:59.670303 16733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:59.670683 16734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07b377bdc7b04aa7b53e01874186f667. Latest consensus state: current_term: 1 leader_uuid: "07b377bdc7b04aa7b53e01874186f667" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07b377bdc7b04aa7b53e01874186f667" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 33547 } } }
I20260805 22:58:59.671077 16734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667 [sys.catalog]: This master's current role is: LEADER
I20260805 22:58:59.673167 16749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:58:59.679060 16749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:58:59.689055 16749 catalog_manager.cc:1347] Generated new cluster ID: 17f9991349d94931bb5ad7395c11b212
I20260805 22:58:59.689288 16749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:58:59.704748 16749 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:58:59.706424 16749 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:58:59.714533 16749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667: Generated new TSK 0
I20260805 22:58:59.715552 16749 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.34.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
Entry for principal kudu/127.20.34.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab.
I20260805 22:58:59.805441 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33547
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:00.189633 16782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:00.189954 16782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:00.190056 16782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:00.197644 16782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:00.197782 16782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:00.197903 16782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:59:00.208194 16782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.65.keytab
--principal=kudu/127.20.34.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33547
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:00.209605 16782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:00.210942 16782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:00.225346 16789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:00.225467 16792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:00.225481 16790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:00.226578 16782 server_base.cc:1034] running on GCE node
I20260805 22:59:00.227418 16782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:00.228616 16782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:00.229838 16782 hybrid_clock.cc:648] HybridClock initialized: now 1785970740229740 us; error 60 us; skew 500 ppm
I20260805 22:59:00.230202 16782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:00 dist-test-slave-gmjp krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970740, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:00.233704 16782 init.cc:377] Logged in from keytab as kudu/127.20.34.65@KRBTEST.COM (short username kudu)
I20260805 22:59:00.235301 16782 webserver.cc:460] Webserver started at http://127.20.34.65:40717/ using document root <none> and password file <none>
I20260805 22:59:00.236045 16782 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:00.236205 16782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:00.236569 16782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:00.239763 16782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "ab7f4d2e7acc4e21b12421717647a9b0"
format_stamp: "Formatted at 2026-08-05 22:59:00 on dist-test-slave-gmjp"
server_key: "c9057271e75b48bba14f6d3e4ad8b804"
server_key_iv: "307e2c6aab148c7bc4aae3f67e846712"
server_key_version: "encryptionkey@0"
I20260805 22:59:00.240721 16782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "ab7f4d2e7acc4e21b12421717647a9b0"
format_stamp: "Formatted at 2026-08-05 22:59:00 on dist-test-slave-gmjp"
server_key: "c9057271e75b48bba14f6d3e4ad8b804"
server_key_iv: "307e2c6aab148c7bc4aae3f67e846712"
server_key_version: "encryptionkey@0"
I20260805 22:59:00.246315 16782 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:59:00.250226 16803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:00.251660 16782 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:59:00.251873 16782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "ab7f4d2e7acc4e21b12421717647a9b0"
format_stamp: "Formatted at 2026-08-05 22:59:00 on dist-test-slave-gmjp"
server_key: "c9057271e75b48bba14f6d3e4ad8b804"
server_key_iv: "307e2c6aab148c7bc4aae3f67e846712"
server_key_version: "encryptionkey@0"
I20260805 22:59:00.252092 16782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:00.290088 16782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:00.294731 16782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:00.295025 16782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:00.296063 16782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:59:00.297603 16782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:59:00.297688 16782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:00.297778 16782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:59:00.297825 16782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:00.334784 16782 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:34587
I20260805 22:59:00.334888 16973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:34587 every 8 connection(s)
I20260805 22:59:00.336308 16782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:59:00.342427 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 16782
I20260805 22:59:00.342653 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:59:00.343271 20617 external_mini_cluster.cc:1428] Setting key e32f585bcd7162918b65471460f2922e
Aug 05 22:59:00 dist-test-slave-gmjp krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970740, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.65@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:00.359133 16976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:00.339193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:41891 (local address 127.20.34.126:33547)
0805 22:59:00.339668 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:00.339673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:00.340864 (+ 1191us) server_negotiation.cc:407] Connection header received
0805 22:59:00.342919 (+ 2055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:00.342926 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:00.343023 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:00.343162 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:00.344932 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:00.345700 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:00.347422 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:00.347851 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:00.348014 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:00.352301 (+ 4287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:00.352306 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:00.352310 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:00.352348 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:00.355342 (+ 2994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:00.356385 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:00.356390 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:00.356392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:00.356535 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:00.357085 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:00.357089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:00.357091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:00.357463 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:00.357633 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:00.358466 (+ 833us) server_negotiation.cc:299] Negotiation successful
0805 22:59:00.358742 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":231,"threads_started":1}
I20260805 22:59:00.360321 16977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:00.339828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33547 (local address 127.20.34.65:41891)
0805 22:59:00.340683 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:00.340726 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:00.342520 (+ 1794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:00.343449 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:00.343459 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:00.344053 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:00.344740 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:00.344762 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:00.345891 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:00.345896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:00.347239 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:00.347254 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:00.348123 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:00.348134 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:00.348450 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:00.349250 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:00.349278 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:00.351979 (+ 2701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:00.355529 (+ 3550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:00.355539 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:00.355562 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:00.356219 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:00.356671 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:00.356676 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:00.356679 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:00.356952 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:00.357604 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:00.357613 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:00.358023 (+ 410us) client_negotiation.cc:769] Sending connection context
0805 22:59:00.358324 (+ 301us) client_negotiation.cc:240] Negotiation successful
0805 22:59:00.358960 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":358,"threads_started":1}
I20260805 22:59:00.362183 16974 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33547
I20260805 22:59:00.362589 16974 heartbeater.cc:464] Registering TS with master...
I20260805 22:59:00.363613 16974 heartbeater.cc:511] Master 127.20.34.126:33547 requested a full tablet report, sending...
I20260805 22:59:00.366552 16677 ts_manager.cc:194] Registered new tserver with Master: ab7f4d2e7acc4e21b12421717647a9b0 (127.20.34.65:34587)
I20260805 22:59:00.369026 16677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.65@KRBTEST.COM'} at 127.20.34.65:41891
WARNING: no policy specified for kudu/127.20.34.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
Entry for principal kudu/127.20.34.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab.
I20260805 22:59:00.428399 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33547
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:00.801112 16982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:00.801417 16982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:00.801601 16982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:00.809142 16982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:00.809278 16982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:00.809522 16982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:59:00.819736 16982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.66.keytab
--principal=kudu/127.20.34.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33547
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:00.821256 16982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:00.822767 16982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:00.836509 16990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:00.836582 16988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:00.836797 16987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:00.837868 16982 server_base.cc:1034] running on GCE node
I20260805 22:59:00.838581 16982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:00.839627 16982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:00.840873 16982 hybrid_clock.cc:648] HybridClock initialized: now 1785970740840830 us; error 33 us; skew 500 ppm
I20260805 22:59:00.841215 16982 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:00 dist-test-slave-gmjp krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970740, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:00.844651 16982 init.cc:377] Logged in from keytab as kudu/127.20.34.66@KRBTEST.COM (short username kudu)
I20260805 22:59:00.846127 16982 webserver.cc:460] Webserver started at http://127.20.34.66:35495/ using document root <none> and password file <none>
I20260805 22:59:00.846808 16982 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:00.846949 16982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:00.847224 16982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:00.850354 16982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "f9868576ef824419bf1c35f0c684f90b"
format_stamp: "Formatted at 2026-08-05 22:59:00 on dist-test-slave-gmjp"
server_key: "5d052e27b53f32a816456c5c6fd35216"
server_key_iv: "900f469d1c913e7762c304a959d98842"
server_key_version: "encryptionkey@0"
I20260805 22:59:00.851120 16982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "f9868576ef824419bf1c35f0c684f90b"
format_stamp: "Formatted at 2026-08-05 22:59:00 on dist-test-slave-gmjp"
server_key: "5d052e27b53f32a816456c5c6fd35216"
server_key_iv: "900f469d1c913e7762c304a959d98842"
server_key_version: "encryptionkey@0"
I20260805 22:59:00.856933 16982 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260805 22:59:00.860860 17005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:00.862382 16982 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260805 22:59:00.862576 16982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "f9868576ef824419bf1c35f0c684f90b"
format_stamp: "Formatted at 2026-08-05 22:59:00 on dist-test-slave-gmjp"
server_key: "5d052e27b53f32a816456c5c6fd35216"
server_key_iv: "900f469d1c913e7762c304a959d98842"
server_key_version: "encryptionkey@0"
I20260805 22:59:00.862784 16982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:00.878739 16982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:00.883674 16982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:00.884020 16982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:00.885207 16982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:59:00.886801 16982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:59:00.886884 16982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:00.887029 16982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:59:00.887089 16982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:00.922894 16982 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:40657
I20260805 22:59:00.922943 17158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:40657 every 8 connection(s)
I20260805 22:59:00.924433 16982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:59:00.926007 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 16982
I20260805 22:59:00.926175 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:59:00.926563 20617 external_mini_cluster.cc:1428] Setting key 772f040d9f1518823c6f467645f9783c
Aug 05 22:59:00 dist-test-slave-gmjp krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970740, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.66@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:00.951848 17162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:00.928660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:40679 (local address 127.20.34.126:33547)
0805 22:59:00.929147 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:00.929154 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:00.930479 (+ 1325us) server_negotiation.cc:407] Connection header received
0805 22:59:00.933476 (+ 2997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:00.933481 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:00.933556 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:00.933661 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:00.935956 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:00.936801 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:00.939419 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:00.939866 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:00.939991 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:00.944875 (+ 4884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:00.944881 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:00.944885 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:00.944927 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:00.947728 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:00.948932 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:00.948937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:00.948940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:00.949093 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:00.949775 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:00.949779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:00.949782 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:00.950124 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:00.950264 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:00.951331 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0805 22:59:00.951534 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":236,"threads_started":1}
I20260805 22:59:00.953575 17163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:00.929370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33547 (local address 127.20.34.66:40679)
0805 22:59:00.930275 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:00.930339 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:00.933117 (+ 2778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:00.933964 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:00.933979 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:00.934826 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:00.935721 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:00.935750 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:00.936972 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:00.936981 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:00.939228 (+ 2247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:00.939248 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:00.940133 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:00.940144 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:00.940534 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:00.941407 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:00.941446 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:00.944545 (+ 3099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:00.947936 (+ 3391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:00.947950 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:00.947973 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:00.948775 (+ 802us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:00.949230 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:00.949238 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:00.949241 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:00.949577 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:00.950275 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:00.950287 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:00.950817 (+ 530us) client_negotiation.cc:769] Sending connection context
0805 22:59:00.951201 (+ 384us) client_negotiation.cc:240] Negotiation successful
0805 22:59:00.951877 (+ 676us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":339,"threads_started":1}
I20260805 22:59:00.955263 17159 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33547
I20260805 22:59:00.955634 17159 heartbeater.cc:464] Registering TS with master...
I20260805 22:59:00.956569 17159 heartbeater.cc:511] Master 127.20.34.126:33547 requested a full tablet report, sending...
I20260805 22:59:00.958293 16677 ts_manager.cc:194] Registered new tserver with Master: f9868576ef824419bf1c35f0c684f90b (127.20.34.66:40657)
I20260805 22:59:00.959205 16677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.66@KRBTEST.COM'} at 127.20.34.66:40679
WARNING: no policy specified for kudu/127.20.34.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
Entry for principal kudu/127.20.34.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab.
I20260805 22:59:01.011893 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33547
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:33467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:59:01.373871 16974 heartbeater.cc:503] Master 127.20.34.126:33547 was elected leader, sending a full tablet report...
W20260805 22:59:01.393941 17167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:01.394309 17167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:01.394500 17167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:01.402102 17167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:01.402268 17167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:01.402462 17167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:59:01.412788 17167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:33467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.67.keytab
--principal=kudu/127.20.34.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:33547
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:01.414249 17167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:01.415661 17167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:01.429714 17173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:01.429783 17178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:01.429733 17174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:01.431020 17167 server_base.cc:1034] running on GCE node
I20260805 22:59:01.431676 17167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:01.432893 17167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:01.434144 17167 hybrid_clock.cc:648] HybridClock initialized: now 1785970741434076 us; error 64 us; skew 500 ppm
I20260805 22:59:01.434499 17167 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:01 dist-test-slave-gmjp krb5kdc[16612](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:01.438031 17167 init.cc:377] Logged in from keytab as kudu/127.20.34.67@KRBTEST.COM (short username kudu)
I20260805 22:59:01.440124 17167 webserver.cc:460] Webserver started at http://127.20.34.67:43023/ using document root <none> and password file <none>
I20260805 22:59:01.441025 17167 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:01.441184 17167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:01.441547 17167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:01.444900 17167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "de1c5da4b6fd40fd9aee96ae32ecd791"
format_stamp: "Formatted at 2026-08-05 22:59:01 on dist-test-slave-gmjp"
server_key: "034816b7b47beb093bf54528d2dc6976"
server_key_iv: "9e7936276581815f88687e21aa4e2cd2"
server_key_version: "encryptionkey@0"
I20260805 22:59:01.445803 17167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "de1c5da4b6fd40fd9aee96ae32ecd791"
format_stamp: "Formatted at 2026-08-05 22:59:01 on dist-test-slave-gmjp"
server_key: "034816b7b47beb093bf54528d2dc6976"
server_key_iv: "9e7936276581815f88687e21aa4e2cd2"
server_key_version: "encryptionkey@0"
I20260805 22:59:01.451557 17167 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:59:01.455613 17187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:01.457222 17167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:59:01.457435 17167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "de1c5da4b6fd40fd9aee96ae32ecd791"
format_stamp: "Formatted at 2026-08-05 22:59:01 on dist-test-slave-gmjp"
server_key: "034816b7b47beb093bf54528d2dc6976"
server_key_iv: "9e7936276581815f88687e21aa4e2cd2"
server_key_version: "encryptionkey@0"
I20260805 22:59:01.457672 17167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:01.476521 17167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:01.481114 17167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:01.481446 17167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:01.482547 17167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:59:01.484026 17167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:59:01.484136 17167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:01.484333 17167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:59:01.484412 17167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:01.525840 17167 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:36683
I20260805 22:59:01.525821 17376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:36683 every 8 connection(s)
I20260805 22:59:01.527487 17167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:59:01.531448 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 17167
I20260805 22:59:01.531672 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:59:01.532320 20617 external_mini_cluster.cc:1428] Setting key 29623c9d9e51c12311df6f02f8f6435c
Aug 05 22:59:01 dist-test-slave-gmjp krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970741, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.67@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:01.549543 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.530365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:59591 (local address 127.20.34.126:33547)
0805 22:59:01.530945 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.530950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.532012 (+ 1062us) server_negotiation.cc:407] Connection header received
0805 22:59:01.534309 (+ 2297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.534313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.534428 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.534561 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:01.536287 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.537135 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.538721 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.539146 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.539245 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.542806 (+ 3561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:01.542811 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:01.542814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:01.542850 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:01.545633 (+ 2783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:01.546723 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:01.546729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:01.546732 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:01.546957 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:01.547527 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:01.547531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:01.547533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:01.547954 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:01.548115 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.549074 (+ 959us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.549260 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":282,"threads_started":1}
I20260805 22:59:01.550647 17381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.530789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:33547 (local address 127.20.34.67:59591)
0805 22:59:01.531820 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:01.531874 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:01.533999 (+ 2125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:01.534763 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:01.534771 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:01.535438 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:01.536049 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.536067 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.537282 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.537286 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.538580 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.538594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.539349 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.539353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.539559 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.540313 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:01.540342 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:01.542559 (+ 2217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:01.545909 (+ 3350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:01.545916 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:01.545932 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:01.546559 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:01.547096 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:01.547101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:01.547104 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:01.547389 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:01.548132 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:01.548143 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:01.548670 (+ 527us) client_negotiation.cc:769] Sending connection context
0805 22:59:01.548962 (+ 292us) client_negotiation.cc:240] Negotiation successful
0805 22:59:01.549429 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":384,"threads_started":1}
I20260805 22:59:01.552125 17378 heartbeater.cc:347] Connected to a master server at 127.20.34.126:33547
I20260805 22:59:01.552507 17378 heartbeater.cc:464] Registering TS with master...
I20260805 22:59:01.553301 17378 heartbeater.cc:511] Master 127.20.34.126:33547 requested a full tablet report, sending...
I20260805 22:59:01.554908 16677 ts_manager.cc:194] Registered new tserver with Master: de1c5da4b6fd40fd9aee96ae32ecd791 (127.20.34.67:36683)
I20260805 22:59:01.555789 16677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.34.67@KRBTEST.COM'} at 127.20.34.67:59591
I20260805 22:59:01.561283 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:59:01.579819 17380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.565821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59976 (local address 127.20.34.126:33547)
0805 22:59:01.566081 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.566086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.566661 (+ 575us) server_negotiation.cc:407] Connection header received
0805 22:59:01.566845 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.566852 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.566963 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.567091 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:01.568789 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.569567 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.570913 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.571363 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.571474 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.574366 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:01.574372 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:01.574375 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:01.574412 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:01.577287 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:01.578018 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:01.578022 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:01.578024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:01.578157 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:01.578534 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:01.578537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:01.578539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:01.578883 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:01.579088 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.579394 (+ 306us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.579582 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260805 22:59:01.584093 16677 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:59:01.591737 16677 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:59:01.617287 17398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.606217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:40657 (local address 127.0.0.1:32972)
0805 22:59:01.608616 (+ 2399us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:01.608632 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:01.608755 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:01.609708 (+ 953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:01.609712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:01.609740 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:01.610304 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.610329 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.612139 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.612144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.614184 (+ 2040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.614199 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.616107 (+ 1908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.616113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.616353 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.616426 (+ 73us) client_negotiation.cc:769] Sending connection context
0805 22:59:01.616603 (+ 177us) client_negotiation.cc:240] Negotiation successful
0805 22:59:01.616828 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2269,"mutex_wait_us":63,"thread_start_us":2110,"threads_started":1}
I20260805 22:59:01.617449 17402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.606155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34587 (local address 127.0.0.1:51922)
0805 22:59:01.607933 (+ 1778us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:01.607971 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:01.608203 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:01.609186 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:01.609193 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:01.609224 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:01.609651 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.609668 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.611771 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.611781 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.614388 (+ 2607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.614403 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.616611 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.616617 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.616775 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.616805 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 22:59:01.616895 (+ 90us) client_negotiation.cc:240] Negotiation successful
0805 22:59:01.617037 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1535,"mutex_wait_us":37,"thread_start_us":1373,"threads_started":1}
I20260805 22:59:01.617560 17397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.606178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51922 (local address 127.20.34.65:34587)
0805 22:59:01.607551 (+ 1373us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.607572 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.608434 (+ 862us) server_negotiation.cc:407] Connection header received
0805 22:59:01.608550 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.608557 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.608848 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.609044 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:01.609888 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.611583 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.614794 (+ 3211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.616365 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.616512 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.616741 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.616967 (+ 226us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.617161 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1116,"thread_start_us":919,"threads_started":1}
I20260805 22:59:01.618191 17401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.606752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32972 (local address 127.20.34.66:40657)
0805 22:59:01.608089 (+ 1337us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.608100 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.608892 (+ 792us) server_negotiation.cc:407] Connection header received
0805 22:59:01.609005 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.609012 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.609240 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.609452 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:01.610562 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.611992 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.614388 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.615885 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.616054 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.616339 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.617803 (+ 1464us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.617975 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1126,"thread_start_us":2131,"threads_started":1}
I20260805 22:59:01.619755 17407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.608463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:36683 (local address 127.0.0.1:44606)
0805 22:59:01.610319 (+ 1856us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:01.610333 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:01.610490 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:01.611338 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:01.611343 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:01.611367 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:01.611800 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.611813 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.613870 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.613876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.616104 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.616121 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.618867 (+ 2746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.618872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.619052 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.619085 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 22:59:01.619224 (+ 139us) client_negotiation.cc:240] Negotiation successful
0805 22:59:01.619355 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1735,"mutex_wait_us":789,"thread_start_us":748,"threads_started":1}
I20260805 22:59:01.620611 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.608961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44606 (local address 127.20.34.67:36683)
0805 22:59:01.609762 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.609774 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.610448 (+ 674us) server_negotiation.cc:407] Connection header received
0805 22:59:01.610670 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.610679 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.610891 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.611080 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:01.612028 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.613697 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.616336 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.618296 (+ 1960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.618423 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.618673 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.620077 (+ 1404us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.620285 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":481,"threads_started":1}
I20260805 22:59:01.621981 17074 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3168d9edb44ecda3012c6b3cacbba0 (DEFAULT_TABLE table=test-table [id=7bb0cd5e48eb46ffb7ffd742e8f3055d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:59:01.622871 16876 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3168d9edb44ecda3012c6b3cacbba0 (DEFAULT_TABLE table=test-table [id=7bb0cd5e48eb46ffb7ffd742e8f3055d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:59:01.623723 17074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3168d9edb44ecda3012c6b3cacbba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:01.624567 16876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3168d9edb44ecda3012c6b3cacbba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:01.624328 17266 tablet_service.cc:1467] Processing CreateTablet for tablet 1f3168d9edb44ecda3012c6b3cacbba0 (DEFAULT_TABLE table=test-table [id=7bb0cd5e48eb46ffb7ffd742e8f3055d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:59:01.625746 17266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f3168d9edb44ecda3012c6b3cacbba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:01.646291 17409 tablet_bootstrap.cc:492] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: Bootstrap starting.
I20260805 22:59:01.646688 17410 tablet_bootstrap.cc:492] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Bootstrap starting.
I20260805 22:59:01.648706 17411 tablet_bootstrap.cc:492] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Bootstrap starting.
I20260805 22:59:01.651535 17409 tablet_bootstrap.cc:654] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:01.651535 17410 tablet_bootstrap.cc:654] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:01.651678 17411 tablet_bootstrap.cc:654] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:01.652920 17411 log.cc:824] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:01.652935 17410 log.cc:824] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:01.652938 17409 log.cc:824] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:01.658054 17409 tablet_bootstrap.cc:492] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: No bootstrap required, opened a new log
I20260805 22:59:01.658053 17410 tablet_bootstrap.cc:492] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: No bootstrap required, opened a new log
I20260805 22:59:01.658398 17409 ts_tablet_manager.cc:1397] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260805 22:59:01.658399 17410 ts_tablet_manager.cc:1397] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260805 22:59:01.662968 17411 tablet_bootstrap.cc:492] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: No bootstrap required, opened a new log
I20260805 22:59:01.663288 17411 ts_tablet_manager.cc:1397] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.006s
I20260805 22:59:01.670076 17409 raft_consensus.cc:348] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.670076 17410 raft_consensus.cc:348] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.670585 17409 raft_consensus.cc:374] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:01.670585 17410 raft_consensus.cc:374] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:01.670698 17410 raft_consensus.cc:729] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de1c5da4b6fd40fd9aee96ae32ecd791, State: Initialized, Role: FOLLOWER
I20260805 22:59:01.670698 17409 raft_consensus.cc:729] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab7f4d2e7acc4e21b12421717647a9b0, State: Initialized, Role: FOLLOWER
I20260805 22:59:01.671406 17410 consensus_queue.cc:260] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.671406 17409 consensus_queue.cc:260] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.672145 17411 raft_consensus.cc:348] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.672693 17411 raft_consensus.cc:374] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:01.672806 17411 raft_consensus.cc:729] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9868576ef824419bf1c35f0c684f90b, State: Initialized, Role: FOLLOWER
I20260805 22:59:01.673482 17378 heartbeater.cc:503] Master 127.20.34.126:33547 was elected leader, sending a full tablet report...
I20260805 22:59:01.673487 17410 ts_tablet_manager.cc:1428] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20260805 22:59:01.673486 17411 consensus_queue.cc:260] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.674309 17409 ts_tablet_manager.cc:1428] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: Time spent starting tablet: real 0.016s user 0.010s sys 0.007s
I20260805 22:59:01.675417 17159 heartbeater.cc:503] Master 127.20.34.126:33547 was elected leader, sending a full tablet report...
W20260805 22:59:01.676424 17160 tablet.cc:2369] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:01.676107 17411 ts_tablet_manager.cc:1428] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
I20260805 22:59:01.731014 17418 raft_consensus.cc:482] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:59:01.731370 17418 raft_consensus.cc:504] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.733189 17418 leader_election.cc:288] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab7f4d2e7acc4e21b12421717647a9b0 (127.20.34.65:34587), de1c5da4b6fd40fd9aee96ae32ecd791 (127.20.34.67:36683)
I20260805 22:59:01.738870 17416 raft_consensus.cc:482] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:59:01.739233 17416 raft_consensus.cc:504] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.741503 17397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.733879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:53645 (local address 127.20.34.65:34587)
0805 22:59:01.734199 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.734207 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.734742 (+ 535us) server_negotiation.cc:407] Connection header received
0805 22:59:01.734978 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.734986 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.735082 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.735180 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:01.735993 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.737091 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.739181 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.740396 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.740602 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.740693 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.741075 (+ 382us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.741227 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260805 22:59:01.741551 17421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.733793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34587 (local address 127.20.34.66:53645)
0805 22:59:01.734565 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:01.734583 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:01.734789 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:01.735271 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:01.735284 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:01.735332 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:01.735812 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.735826 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.737237 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.737245 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.738962 (+ 1717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.738980 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.740636 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.740643 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.740869 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.740900 (+ 31us) client_negotiation.cc:769] Sending connection context
0805 22:59:01.741032 (+ 132us) client_negotiation.cc:240] Negotiation successful
0805 22:59:01.741189 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":459,"threads_started":1}
I20260805 22:59:01.742888 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.734965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:58025 (local address 127.20.34.67:36683)
0805 22:59:01.735191 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.735209 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.735813 (+ 604us) server_negotiation.cc:407] Connection header received
0805 22:59:01.735933 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.735938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.736019 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.736089 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:01.736808 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.737676 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.740024 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.741553 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.741724 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.741805 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.742403 (+ 598us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.742549 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 22:59:01.742973 16906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3168d9edb44ecda3012c6b3cacbba0" candidate_uuid: "f9868576ef824419bf1c35f0c684f90b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" is_pre_election: true
I20260805 22:59:01.743691 17416 leader_election.cc:288] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab7f4d2e7acc4e21b12421717647a9b0 (127.20.34.65:34587), f9868576ef824419bf1c35f0c684f90b (127.20.34.66:40657)
I20260805 22:59:01.743805 17423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.734731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:36683 (local address 127.20.34.66:58025)
0805 22:59:01.735681 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:01.735697 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:01.735823 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:01.736139 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:01.736144 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:01.736220 (+ 76us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:01.736604 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.736616 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.737823 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.737831 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.739819 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.739840 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.741975 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.741984 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.742177 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.742217 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 22:59:01.743062 (+ 845us) client_negotiation.cc:240] Negotiation successful
0805 22:59:01.743246 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"thread_start_us":572,"threads_started":1}
I20260805 22:59:01.743677 16906 raft_consensus.cc:2454] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9868576ef824419bf1c35f0c684f90b in term 0.
I20260805 22:59:01.744931 17006 leader_election.cc:302] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab7f4d2e7acc4e21b12421717647a9b0, f9868576ef824419bf1c35f0c684f90b; no voters:
I20260805 22:59:01.744848 17293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3168d9edb44ecda3012c6b3cacbba0" candidate_uuid: "f9868576ef824419bf1c35f0c684f90b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" is_pre_election: true
I20260805 22:59:01.745362 17293 raft_consensus.cc:2454] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9868576ef824419bf1c35f0c684f90b in term 0.
I20260805 22:59:01.745445 17418 raft_consensus.cc:2781] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:59:01.745594 17418 raft_consensus.cc:482] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:59:01.745692 17418 raft_consensus.cc:3037] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:01.749428 17397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.742183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:53101 (local address 127.20.34.65:34587)
0805 22:59:01.742847 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.742855 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.742872 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:59:01.742928 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.742935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.743013 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.743561 (+ 548us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:01.743737 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.744907 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.747464 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.748429 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.748618 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.748701 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.748990 (+ 289us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.749132 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541}
I20260805 22:59:01.749420 17381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.742115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:34587 (local address 127.20.34.67:53101)
0805 22:59:01.742423 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:01.742444 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:01.742587 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:01.743189 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:01.743195 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:01.743225 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:01.743418 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.743432 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.745106 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.745113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.747272 (+ 2159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.747288 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.748604 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.748610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.748827 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.748853 (+ 26us) client_negotiation.cc:769] Sending connection context
0805 22:59:01.748964 (+ 111us) client_negotiation.cc:240] Negotiation successful
0805 22:59:01.749103 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":1}
I20260805 22:59:01.749408 17418 raft_consensus.cc:504] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.750427 16906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3168d9edb44ecda3012c6b3cacbba0" candidate_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" is_pre_election: true
I20260805 22:59:01.750694 16906 raft_consensus.cc:2454] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de1c5da4b6fd40fd9aee96ae32ecd791 in term 0.
I20260805 22:59:01.750720 17293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3168d9edb44ecda3012c6b3cacbba0" candidate_uuid: "f9868576ef824419bf1c35f0c684f90b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791"
I20260805 22:59:01.750806 16905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3168d9edb44ecda3012c6b3cacbba0" candidate_uuid: "f9868576ef824419bf1c35f0c684f90b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab7f4d2e7acc4e21b12421717647a9b0"
I20260805 22:59:01.750943 17418 leader_election.cc:288] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [CANDIDATE]: Term 1 election: Requested vote from peers ab7f4d2e7acc4e21b12421717647a9b0 (127.20.34.65:34587), de1c5da4b6fd40fd9aee96ae32ecd791 (127.20.34.67:36683)
I20260805 22:59:01.750936 17293 raft_consensus.cc:3037] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:01.751077 16905 raft_consensus.cc:3037] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:01.752923 17190 leader_election.cc:302] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab7f4d2e7acc4e21b12421717647a9b0, de1c5da4b6fd40fd9aee96ae32ecd791; no voters:
I20260805 22:59:01.754077 17401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.743553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:57099 (local address 127.20.34.66:40657)
0805 22:59:01.743743 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.743749 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.745149 (+ 1400us) server_negotiation.cc:407] Connection header received
0805 22:59:01.745459 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.745465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.745544 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.745642 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:01.746568 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.747454 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.750030 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.751356 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.751518 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.751597 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.753654 (+ 2057us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.753820 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260805 22:59:01.754323 17424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.742972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:40657 (local address 127.20.34.67:57099)
0805 22:59:01.745039 (+ 2067us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:01.745060 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:01.745261 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:01.745853 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:01.745860 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:01.745888 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:01.746354 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.746372 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.747620 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.747625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.749787 (+ 2162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:01.749801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.753022 (+ 3221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.753028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:01.753222 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.753257 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 22:59:01.753578 (+ 321us) client_negotiation.cc:240] Negotiation successful
0805 22:59:01.753875 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1905,"mutex_wait_us":30,"thread_start_us":3302,"threads_started":1}
I20260805 22:59:01.754799 16905 raft_consensus.cc:2454] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9868576ef824419bf1c35f0c684f90b in term 1.
I20260805 22:59:01.755326 17006 leader_election.cc:302] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab7f4d2e7acc4e21b12421717647a9b0, f9868576ef824419bf1c35f0c684f90b; no voters:
I20260805 22:59:01.755393 17099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f3168d9edb44ecda3012c6b3cacbba0" candidate_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9868576ef824419bf1c35f0c684f90b" is_pre_election: true
I20260805 22:59:01.755892 17293 raft_consensus.cc:2454] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9868576ef824419bf1c35f0c684f90b in term 1.
I20260805 22:59:01.755941 17099 raft_consensus.cc:2379] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de1c5da4b6fd40fd9aee96ae32ecd791 in current term 1: Already voted for candidate f9868576ef824419bf1c35f0c684f90b in this term.
I20260805 22:59:01.756136 17416 raft_consensus.cc:2741] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260805 22:59:01.756738 17418 raft_consensus.cc:2781] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:01.757336 17418 raft_consensus.cc:686] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 1 LEADER]: Becoming Leader. State: Replica: f9868576ef824419bf1c35f0c684f90b, State: Running, Role: LEADER
I20260805 22:59:01.757866 17418 consensus_queue.cc:237] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } }
I20260805 22:59:01.763288 16674 catalog_manager.cc:5495] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b reported cstate change: term changed from 0 to 1, leader changed from <none> to f9868576ef824419bf1c35f0c684f90b (127.20.34.66). New cstate: current_term: 1 leader_uuid: "f9868576ef824419bf1c35f0c684f90b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9868576ef824419bf1c35f0c684f90b" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 40657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 } health_report { overall_health: UNKNOWN } } }
W20260805 22:59:01.779362 17379 tablet.cc:2369] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:01.783278 17401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.777190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32976 (local address 127.20.34.66:40657)
0805 22:59:01.777382 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.777387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.777461 (+ 74us) server_negotiation.cc:407] Connection header received
0805 22:59:01.777663 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.777667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.777755 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.777922 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:01.778282 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.779076 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.780999 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.781440 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.781545 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.782057 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:01.782572 (+ 515us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:01.782705 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.782856 (+ 151us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.782933 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:59:01.792424 17293 raft_consensus.cc:1261] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 1 FOLLOWER]: Refusing update from remote peer f9868576ef824419bf1c35f0c684f90b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:59:01.792459 16905 raft_consensus.cc:1261] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 1 FOLLOWER]: Refusing update from remote peer f9868576ef824419bf1c35f0c684f90b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:59:01.793423 17425 consensus_queue.cc:1035] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [LEADER]: Connected to new peer: Peer: permanent_uuid: "de1c5da4b6fd40fd9aee96ae32ecd791" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 36683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:59:01.793830 17418 consensus_queue.cc:1035] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab7f4d2e7acc4e21b12421717647a9b0" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 34587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:59:01.806161 17435 mvcc.cc:205] Tried to move back new op lower bound from 7315336158369579008 to 7315336158244130816. Current Snapshot: MvccSnapshot[applied={T|T < 7315336158369579008}]
I20260805 22:59:01.823325 16674 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:59:01.823679 16674 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:59:01.827906 16674 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07b377bdc7b04aa7b53e01874186f667: Sending DeleteTablet for 3 replicas of tablet 1f3168d9edb44ecda3012c6b3cacbba0
I20260805 22:59:01.829452 17266 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3168d9edb44ecda3012c6b3cacbba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:59:01 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:44606
I20260805 22:59:01.829447 17074 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3168d9edb44ecda3012c6b3cacbba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:59:01 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:32972
I20260805 22:59:01.829905 16876 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f3168d9edb44ecda3012c6b3cacbba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:59:01 UTC) from {username='kudu', principal='kudu/127.20.34.126@KRBTEST.COM'} at 127.0.0.1:51922
I20260805 22:59:01.830623 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 16782
I20260805 22:59:01.842562 17449 tablet_replica.cc:330] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: stopping tablet replica
I20260805 22:59:01.843439 17447 tablet_replica.cc:330] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: stopping tablet replica
I20260805 22:59:01.844424 17447 raft_consensus.cc:2229] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:59:01.845057 17449 raft_consensus.cc:2229] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:59:01.845741 17449 raft_consensus.cc:2258] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:59:01.846607 17447 raft_consensus.cc:2258] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:59:01.849902 17449 ts_tablet_manager.cc:1905] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:59:01.852723 17450 tablet_replica.cc:330] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: stopping tablet replica
I20260805 22:59:01.853246 17447 ts_tablet_manager.cc:1905] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:59:01.853329 17450 raft_consensus.cc:2229] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:59:01.854045 17450 raft_consensus.cc:2258] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:59:01.856632 17450 ts_tablet_manager.cc:1905] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:59:01.860277 17449 ts_tablet_manager.cc:1918] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:59:01.860489 17449 log.cc:1196] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/1f3168d9edb44ecda3012c6b3cacbba0
I20260805 22:59:01.861161 17449 ts_tablet_manager.cc:1939] T 1f3168d9edb44ecda3012c6b3cacbba0 P de1c5da4b6fd40fd9aee96ae32ecd791: Deleting consensus metadata
I20260805 22:59:01.863498 16652 catalog_manager.cc:4841] TS de1c5da4b6fd40fd9aee96ae32ecd791 (127.20.34.67:36683): tablet 1f3168d9edb44ecda3012c6b3cacbba0 (table test-table [id=7bb0cd5e48eb46ffb7ffd742e8f3055d]) successfully deleted
I20260805 22:59:01.863880 17447 ts_tablet_manager.cc:1918] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:59:01.864089 17447 log.cc:1196] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/1f3168d9edb44ecda3012c6b3cacbba0
I20260805 22:59:01.864699 17447 ts_tablet_manager.cc:1939] T 1f3168d9edb44ecda3012c6b3cacbba0 P f9868576ef824419bf1c35f0c684f90b: Deleting consensus metadata
Aug 05 22:59:01 dist-test-slave-gmjp krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.65@KRBTEST.COM
I20260805 22:59:01.865760 17450 ts_tablet_manager.cc:1918] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:59:01.866046 17450 log.cc:1196] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970399628623-20617-0/minicluster-data/ts-0/wal/wals/1f3168d9edb44ecda3012c6b3cacbba0
I20260805 22:59:01.866709 17450 ts_tablet_manager.cc:1939] T 1f3168d9edb44ecda3012c6b3cacbba0 P ab7f4d2e7acc4e21b12421717647a9b0: Deleting consensus metadata
I20260805 22:59:01.866844 16653 catalog_manager.cc:4841] TS f9868576ef824419bf1c35f0c684f90b (127.20.34.66:40657): tablet 1f3168d9edb44ecda3012c6b3cacbba0 (table test-table [id=7bb0cd5e48eb46ffb7ffd742e8f3055d]) successfully deleted
I20260805 22:59:01.868897 16652 catalog_manager.cc:4841] TS ab7f4d2e7acc4e21b12421717647a9b0 (127.20.34.65:34587): tablet 1f3168d9edb44ecda3012c6b3cacbba0 (table test-table [id=7bb0cd5e48eb46ffb7ffd742e8f3055d]) successfully deleted
I20260805 22:59:01.874521 17397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:01.832414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51936 (local address 127.20.34.65:34587)
0805 22:59:01.832619 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:01.832626 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:01.845012 (+ 12386us) server_negotiation.cc:407] Connection header received
0805 22:59:01.845634 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:01.845640 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:01.845756 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:01.845863 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:01.847960 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.849182 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.851213 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:01.851926 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:01.852046 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:01.866608 (+ 14562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:01.866628 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:01.866648 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:01.866707 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:01.871048 (+ 4341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:01.871987 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:01.872000 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:01.872005 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:01.872243 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:01.872713 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:01.872719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:01.872723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:01.873258 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:01.873612 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:01.873849 (+ 237us) server_negotiation.cc:299] Negotiation successful
0805 22:59:01.874125 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 22:59:01.875345 16968 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:01.969010 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 16782
I20260805 22:59:02.008615 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 16982
Aug 05 22:59:02 dist-test-slave-gmjp krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.66@KRBTEST.COM
I20260805 22:59:02.028873 17401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:02.009511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32984 (local address 127.20.34.66:40657)
0805 22:59:02.009743 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:02.009748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:02.009768 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:59:02.009997 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:02.010001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:02.010069 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:02.010165 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:02.012033 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:02.012963 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:02.015046 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:02.015556 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:02.015677 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:02.021513 (+ 5836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:02.021534 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:02.021552 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:02.021612 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:02.025499 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:02.026369 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:02.026378 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:02.026381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:02.026550 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:02.027041 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:02.027053 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:02.027056 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:02.027480 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:02.027839 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:02.028202 (+ 363us) server_negotiation.cc:299] Negotiation successful
0805 22:59:02.028499 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:59:02.029633 17153 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:02.149757 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 16982
I20260805 22:59:02.182457 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 17167
Aug 05 22:59:02 dist-test-slave-gmjp krb5kdc[16612](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.67@KRBTEST.COM
I20260805 22:59:02.200299 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:02.183386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44616 (local address 127.20.34.67:36683)
0805 22:59:02.183596 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:02.183603 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:02.183626 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:59:02.183868 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:02.183872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:02.183952 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:02.184064 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:02.185615 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:02.186370 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:02.187709 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:02.188197 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:02.188348 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:02.193663 (+ 5315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:02.193685 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:02.193705 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:02.193756 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:02.197020 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:02.197893 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:02.197903 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:02.197905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:02.198080 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:02.198608 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:02.198613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:02.198615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:02.199061 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:02.199303 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:02.199670 (+ 367us) server_negotiation.cc:299] Negotiation successful
0805 22:59:02.199894 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:59:02.201038 17368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:02.295328 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 17167
I20260805 22:59:02.322953 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 16630
I20260805 22:59:02.324224 16720 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:02.442610 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 16630
2026-08-05T22:59:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5072 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-05T22:59:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:02Z Disabled control of system clock
I20260805 22:59:02.554097 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:44665
--webserver_interface=127.20.34.126
--webserver_port=0
--builtin_ntp_servers=127.20.34.84:41203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:44665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:59:02.924788 17462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:02.925086 17462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:02.925169 17462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:02.932610 17462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:02.932731 17462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:02.932770 17462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:02.932821 17462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:02.932875 17462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:02.942667 17462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:44665
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:44665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:02.944021 17462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:02.946012 17462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:02.959000 17475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:02.958916 17471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:02.958994 17472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:02.959831 17462 server_base.cc:1034] running on GCE node
I20260805 22:59:02.960847 17462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:02.962467 17462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:02.963675 17462 hybrid_clock.cc:648] HybridClock initialized: now 1785970742963619 us; error 81 us; skew 500 ppm
I20260805 22:59:02.964064 17462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:59:02.966594 17462 webserver.cc:460] Webserver started at http://127.20.34.126:35867/ using document root <none> and password file <none>
I20260805 22:59:02.967312 17462 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:02.967407 17462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:02.967692 17462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:02.970947 17462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "decea54b70bf4323af29a4ce2546c389"
format_stamp: "Formatted at 2026-08-05 22:59:02 on dist-test-slave-gmjp"
server_key: "7670e317638ab8ea285a56e974f505ca"
server_key_iv: "c5318fddd34cb0c7430e361a705a1862"
server_key_version: "encryptionkey@0"
I20260805 22:59:02.971805 17462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "decea54b70bf4323af29a4ce2546c389"
format_stamp: "Formatted at 2026-08-05 22:59:02 on dist-test-slave-gmjp"
server_key: "7670e317638ab8ea285a56e974f505ca"
server_key_iv: "c5318fddd34cb0c7430e361a705a1862"
server_key_version: "encryptionkey@0"
I20260805 22:59:02.977880 17462 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260805 22:59:02.981882 17483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:02.983438 17462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:59:02.983675 17462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "decea54b70bf4323af29a4ce2546c389"
format_stamp: "Formatted at 2026-08-05 22:59:02 on dist-test-slave-gmjp"
server_key: "7670e317638ab8ea285a56e974f505ca"
server_key_iv: "c5318fddd34cb0c7430e361a705a1862"
server_key_version: "encryptionkey@0"
I20260805 22:59:02.983932 17462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:03.005667 17462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:03.006690 17462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:03.007025 17462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:03.027688 17462 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:44665
I20260805 22:59:03.027712 17563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:44665 every 8 connection(s)
I20260805 22:59:03.029292 17462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:03.031036 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 17462
I20260805 22:59:03.031256 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:03.031718 20617 external_mini_cluster.cc:1428] Setting key 5c5ac93d49a092c002707cc35edf2fe0
I20260805 22:59:03.034044 17565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:03.045822 17570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:03.033806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53376 (local address 127.20.34.126:44665)
0805 22:59:03.034905 (+ 1099us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:03.034916 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:03.034960 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:59:03.036706 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:03.036730 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:03.037209 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:03.037663 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:03.038262 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:03.039656 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:03.041139 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:03.041819 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:03.042022 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:03.043329 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:03.043337 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:03.043355 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:03.043965 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:03.044045 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:03.044067 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:03.044242 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:03.044466 (+ 224us) server_negotiation.cc:299] Negotiation successful
0805 22:59:03.044830 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":426,"threads_started":1}
I20260805 22:59:03.046111 17565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389: Bootstrap starting.
I20260805 22:59:03.049765 17565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:03.050896 17565 log.cc:824] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:03.053791 17565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389: No bootstrap required, opened a new log
I20260805 22:59:03.061700 17565 raft_consensus.cc:348] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "decea54b70bf4323af29a4ce2546c389" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44665 } }
I20260805 22:59:03.062115 17565 raft_consensus.cc:374] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:03.062193 17565 raft_consensus.cc:729] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: decea54b70bf4323af29a4ce2546c389, State: Initialized, Role: FOLLOWER
I20260805 22:59:03.062814 17565 consensus_queue.cc:260] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "decea54b70bf4323af29a4ce2546c389" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44665 } }
I20260805 22:59:03.063030 17565 raft_consensus.cc:388] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:03.063134 17565 raft_consensus.cc:482] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:03.063266 17565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:03.065538 17565 raft_consensus.cc:504] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "decea54b70bf4323af29a4ce2546c389" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44665 } }
I20260805 22:59:03.066038 17565 leader_election.cc:302] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: decea54b70bf4323af29a4ce2546c389; no voters:
I20260805 22:59:03.066735 17565 leader_election.cc:288] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:03.066896 17574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:03.067806 17574 raft_consensus.cc:686] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [term 1 LEADER]: Becoming Leader. State: Replica: decea54b70bf4323af29a4ce2546c389, State: Running, Role: LEADER
I20260805 22:59:03.068431 17574 consensus_queue.cc:237] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "decea54b70bf4323af29a4ce2546c389" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44665 } }
I20260805 22:59:03.069244 17565 sys_catalog.cc:564] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:03.071350 17576 sys_catalog.cc:455] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "decea54b70bf4323af29a4ce2546c389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "decea54b70bf4323af29a4ce2546c389" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44665 } } }
I20260805 22:59:03.071892 17576 sys_catalog.cc:458] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:03.071856 17577 sys_catalog.cc:455] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [sys.catalog]: SysCatalogTable state changed. Reason: New leader decea54b70bf4323af29a4ce2546c389. Latest consensus state: current_term: 1 leader_uuid: "decea54b70bf4323af29a4ce2546c389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "decea54b70bf4323af29a4ce2546c389" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 44665 } } }
I20260805 22:59:03.072280 17577 sys_catalog.cc:458] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:03.076929 17589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:03.083990 17589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:03.093991 17589 catalog_manager.cc:1347] Generated new cluster ID: a3af49446ed641dc8838f64af390a076
I20260805 22:59:03.094143 17589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:03.110155 17589 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:03.111577 17589 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:03.124876 17589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389: Generated new TSK 0
I20260805 22:59:03.125912 17589 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:03.133375 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.65:0
--local_ip_for_outbound_sockets=127.20.34.65
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:44665
--builtin_ntp_servers=127.20.34.84:41203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 22:59:03.515844 17605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:03.516230 17605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:03.516422 17605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:03.524156 17605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:03.524372 17605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:03.524570 17605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.65
I20260805 22:59:03.535709 17605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.34.65
--webserver_port=0
--tserver_master_addrs=127.20.34.126:44665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.65
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:03.537204 17605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:03.539177 17605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:03.553514 17612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:03.553558 17614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:03.553479 17617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:03.554636 17605 server_base.cc:1034] running on GCE node
I20260805 22:59:03.555390 17605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:03.556471 17605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:03.557719 17605 hybrid_clock.cc:648] HybridClock initialized: now 1785970743557673 us; error 53 us; skew 500 ppm
I20260805 22:59:03.558075 17605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:59:03.560758 17605 webserver.cc:460] Webserver started at http://127.20.34.65:41117/ using document root <none> and password file <none>
I20260805 22:59:03.561493 17605 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:03.561587 17605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:03.561887 17605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:03.564991 17605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/data/instance:
uuid: "33f75655255b4559bc5e5de08d349ef1"
format_stamp: "Formatted at 2026-08-05 22:59:03 on dist-test-slave-gmjp"
server_key: "2ee28efd7b951989f9fd17928d9e345c"
server_key_iv: "478a0286f20aff086e4dbfda3a417765"
server_key_version: "encryptionkey@0"
I20260805 22:59:03.565780 17605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance:
uuid: "33f75655255b4559bc5e5de08d349ef1"
format_stamp: "Formatted at 2026-08-05 22:59:03 on dist-test-slave-gmjp"
server_key: "2ee28efd7b951989f9fd17928d9e345c"
server_key_iv: "478a0286f20aff086e4dbfda3a417765"
server_key_version: "encryptionkey@0"
I20260805 22:59:03.571442 17605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:59:03.576043 17623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:03.577713 17605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:59:03.577946 17605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/wal
uuid: "33f75655255b4559bc5e5de08d349ef1"
format_stamp: "Formatted at 2026-08-05 22:59:03 on dist-test-slave-gmjp"
server_key: "2ee28efd7b951989f9fd17928d9e345c"
server_key_iv: "478a0286f20aff086e4dbfda3a417765"
server_key_version: "encryptionkey@0"
I20260805 22:59:03.578205 17605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:03.601889 17605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:03.602806 17605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:03.603150 17605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:03.604238 17605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:59:03.605943 17605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:59:03.606074 17605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:03.606215 17605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:59:03.606310 17605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:03.642840 17605 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.65:33549
I20260805 22:59:03.642940 17781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.65:33549 every 8 connection(s)
I20260805 22:59:03.644306 17605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/data/info.pb
I20260805 22:59:03.648885 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 17605
I20260805 22:59:03.649083 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-0/wal/instance
I20260805 22:59:03.649694 20617 external_mini_cluster.cc:1428] Setting key 04c8a4d751bf33a3d3d73db8a7b41e76
I20260805 22:59:03.653151 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.66:0
--local_ip_for_outbound_sockets=127.20.34.66
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:44665
--builtin_ntp_servers=127.20.34.84:41203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:59:03.659495 17784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:03.647082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.65:32947 (local address 127.20.34.126:44665)
0805 22:59:03.647580 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:03.647585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:03.648908 (+ 1323us) server_negotiation.cc:407] Connection header received
0805 22:59:03.651309 (+ 2401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:03.651314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:03.651382 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:03.651468 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:03.652910 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:03.653734 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:03.656376 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:03.656782 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:03.656916 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:03.658695 (+ 1779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:03.658700 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:03.658703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:03.658723 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:03.658766 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:03.658779 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:03.658856 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:03.659126 (+ 270us) server_negotiation.cc:299] Negotiation successful
0805 22:59:03.659213 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":278,"threads_started":1}
I20260805 22:59:03.661116 17785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:03.647607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:44665 (local address 127.20.34.65:32947)
0805 22:59:03.648693 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:03.648750 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:03.650998 (+ 2248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:03.651733 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:03.651742 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:03.651841 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:03.652705 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:03.652732 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:03.653906 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:03.653914 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:03.656225 (+ 2311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:03.656243 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:03.657046 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:03.657055 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:03.657437 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:03.658255 (+ 818us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:59:03.658260 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:03.658320 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:59:03.658466 (+ 146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:03.658877 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:03.658891 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:03.658902 (+ 11us) client_negotiation.cc:769] Sending connection context
0805 22:59:03.659092 (+ 190us) client_negotiation.cc:240] Negotiation successful
0805 22:59:03.659575 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":282,"threads_started":1}
I20260805 22:59:03.662957 17782 heartbeater.cc:347] Connected to a master server at 127.20.34.126:44665
I20260805 22:59:03.663314 17782 heartbeater.cc:464] Registering TS with master...
I20260805 22:59:03.664223 17782 heartbeater.cc:511] Master 127.20.34.126:44665 requested a full tablet report, sending...
I20260805 22:59:03.666684 17510 ts_manager.cc:194] Registered new tserver with Master: 33f75655255b4559bc5e5de08d349ef1 (127.20.34.65:33549)
I20260805 22:59:03.668869 17510 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.65:32947
W20260805 22:59:04.027594 17786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:04.027988 17786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:04.028214 17786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:04.036374 17786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:04.036538 17786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:04.036722 17786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.66
I20260805 22:59:04.046958 17786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.34.66
--webserver_port=0
--tserver_master_addrs=127.20.34.126:44665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.66
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:04.048595 17786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:04.050521 17786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:04.065400 17792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:04.065465 17796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:04.065332 17793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:04.066543 17786 server_base.cc:1034] running on GCE node
I20260805 22:59:04.067230 17786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:04.068424 17786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:04.069720 17786 hybrid_clock.cc:648] HybridClock initialized: now 1785970744069647 us; error 53 us; skew 500 ppm
I20260805 22:59:04.070111 17786 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:59:04.072888 17786 webserver.cc:460] Webserver started at http://127.20.34.66:36761/ using document root <none> and password file <none>
I20260805 22:59:04.073671 17786 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:04.073819 17786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:04.074179 17786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:04.077509 17786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/data/instance:
uuid: "0436e386824b4075b73499ac7c2e57a7"
format_stamp: "Formatted at 2026-08-05 22:59:04 on dist-test-slave-gmjp"
server_key: "dea35e6245efb88269db485cf50504af"
server_key_iv: "43a20b0b758bb7a724b7d6dc3d6693e7"
server_key_version: "encryptionkey@0"
I20260805 22:59:04.078415 17786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance:
uuid: "0436e386824b4075b73499ac7c2e57a7"
format_stamp: "Formatted at 2026-08-05 22:59:04 on dist-test-slave-gmjp"
server_key: "dea35e6245efb88269db485cf50504af"
server_key_iv: "43a20b0b758bb7a724b7d6dc3d6693e7"
server_key_version: "encryptionkey@0"
I20260805 22:59:04.084748 17786 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 22:59:04.088789 17804 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:04.090488 17786 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:59:04.090705 17786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/wal
uuid: "0436e386824b4075b73499ac7c2e57a7"
format_stamp: "Formatted at 2026-08-05 22:59:04 on dist-test-slave-gmjp"
server_key: "dea35e6245efb88269db485cf50504af"
server_key_iv: "43a20b0b758bb7a724b7d6dc3d6693e7"
server_key_version: "encryptionkey@0"
I20260805 22:59:04.090968 17786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:04.115600 17786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:04.116653 17786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:04.117007 17786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:04.118120 17786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:59:04.119925 17786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:59:04.120062 17786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:04.120232 17786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:59:04.120334 17786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:04.156466 17786 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.66:36143
I20260805 22:59:04.156562 17962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.66:36143 every 8 connection(s)
I20260805 22:59:04.157974 17786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/data/info.pb
I20260805 22:59:04.163659 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 17786
I20260805 22:59:04.163877 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/wal/instance
I20260805 22:59:04.164492 20617 external_mini_cluster.cc:1428] Setting key f48974486fc592a843f16276df2f2e85
I20260805 22:59:04.167877 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.34.67:0
--local_ip_for_outbound_sockets=127.20.34.67
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:44665
--builtin_ntp_servers=127.20.34.84:41203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 22:59:04.173373 17967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.161040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.66:53265 (local address 127.20.34.126:44665)
0805 22:59:04.161496 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.161501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.162887 (+ 1386us) server_negotiation.cc:407] Connection header received
0805 22:59:04.165492 (+ 2605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.165498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.165600 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.165748 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:04.167024 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.168218 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.169946 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.170720 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.170875 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.172342 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:04.172351 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:04.172359 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:04.172388 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:04.172444 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:04.172464 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:04.172562 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.172787 (+ 225us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.172918 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":214,"threads_started":1}
I20260805 22:59:04.174394 17969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.161769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:44665 (local address 127.20.34.66:53265)
0805 22:59:04.162708 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:04.162749 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:04.165163 (+ 2414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:04.165983 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:04.165992 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:04.166097 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:04.166816 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.166860 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.168375 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.168379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.169772 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.169786 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.170948 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.170954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.171168 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.171945 (+ 777us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:59:04.171947 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:04.171992 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:59:04.172083 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:04.172567 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:04.172577 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:04.172582 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 22:59:04.172742 (+ 160us) client_negotiation.cc:240] Negotiation successful
0805 22:59:04.173112 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":275,"threads_started":1}
I20260805 22:59:04.176011 17963 heartbeater.cc:347] Connected to a master server at 127.20.34.126:44665
I20260805 22:59:04.176419 17963 heartbeater.cc:464] Registering TS with master...
I20260805 22:59:04.177441 17963 heartbeater.cc:511] Master 127.20.34.126:44665 requested a full tablet report, sending...
I20260805 22:59:04.179117 17510 ts_manager.cc:194] Registered new tserver with Master: 0436e386824b4075b73499ac7c2e57a7 (127.20.34.66:36143)
I20260805 22:59:04.180008 17510 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.66:53265
W20260805 22:59:04.590826 17970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:04.591219 17970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:04.591394 17970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:04.599577 17970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:04.599736 17970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:04.599931 17970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.34.67
I20260805 22:59:04.609932 17970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:41203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.34.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.34.67
--webserver_port=0
--tserver_master_addrs=127.20.34.126:44665
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.34.67
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:04.611481 17970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:04.613543 17970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:04.627803 17981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:04.628242 17984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:04.628232 17980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:04.630558 17970 server_base.cc:1034] running on GCE node
I20260805 22:59:04.631466 17970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:04.632750 17970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:04.634032 17970 hybrid_clock.cc:648] HybridClock initialized: now 1785970744633962 us; error 70 us; skew 500 ppm
I20260805 22:59:04.634423 17970 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 22:59:04.641511 17970 webserver.cc:460] Webserver started at http://127.20.34.67:32875/ using document root <none> and password file <none>
I20260805 22:59:04.642431 17970 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:04.642613 17970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:04.643003 17970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:04.646837 17970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/data/instance:
uuid: "53a4eb9b02f649fe8e7b942a3125d324"
format_stamp: "Formatted at 2026-08-05 22:59:04 on dist-test-slave-gmjp"
server_key: "fd7e490cddc5de06c68fade10976a5af"
server_key_iv: "ee523782ac3f8c43753cccc121569544"
server_key_version: "encryptionkey@0"
I20260805 22:59:04.647871 17970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance:
uuid: "53a4eb9b02f649fe8e7b942a3125d324"
format_stamp: "Formatted at 2026-08-05 22:59:04 on dist-test-slave-gmjp"
server_key: "fd7e490cddc5de06c68fade10976a5af"
server_key_iv: "ee523782ac3f8c43753cccc121569544"
server_key_version: "encryptionkey@0"
I20260805 22:59:04.655251 17970 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260805 22:59:04.660550 17991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:04.662195 17970 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260805 22:59:04.662400 17970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/wal
uuid: "53a4eb9b02f649fe8e7b942a3125d324"
format_stamp: "Formatted at 2026-08-05 22:59:04 on dist-test-slave-gmjp"
server_key: "fd7e490cddc5de06c68fade10976a5af"
server_key_iv: "ee523782ac3f8c43753cccc121569544"
server_key_version: "encryptionkey@0"
I20260805 22:59:04.662652 17970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:04.672983 17782 heartbeater.cc:503] Master 127.20.34.126:44665 was elected leader, sending a full tablet report...
I20260805 22:59:04.676690 17970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:04.677592 17970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:04.677927 17970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:04.679042 17970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 22:59:04.680644 17970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 22:59:04.680768 17970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:04.680900 17970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 22:59:04.680995 17970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:04.716670 17970 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.67:34153
I20260805 22:59:04.716758 18155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.67:34153 every 8 connection(s)
I20260805 22:59:04.718114 17970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/data/info.pb
I20260805 22:59:04.720692 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 17970
I20260805 22:59:04.720893 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/wal/instance
I20260805 22:59:04.721589 20617 external_mini_cluster.cc:1428] Setting key d7546326f7eff42ceca587cb235c8f85
I20260805 22:59:04.732133 18160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.721298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:35289 (local address 127.20.34.126:44665)
0805 22:59:04.721901 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.721906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.723328 (+ 1422us) server_negotiation.cc:407] Connection header received
0805 22:59:04.725243 (+ 1915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.725248 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.725362 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.725458 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:04.726682 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.727490 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.729318 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.729814 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.729921 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.731308 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:04.731315 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:04.731320 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:04.731339 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:04.731386 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:04.731398 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:04.731495 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.731739 (+ 244us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.731829 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":297,"threads_started":1}
I20260805 22:59:04.733297 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.721950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:44665 (local address 127.20.34.67:35289)
0805 22:59:04.723148 (+ 1198us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:04.723199 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:04.724990 (+ 1791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:04.725725 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:04.725736 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:04.725848 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:04.726497 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.726515 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.727662 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.727666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.729153 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.729166 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.730022 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.730027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.730229 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.730944 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 22:59:04.730947 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:04.730989 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 22:59:04.731090 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:04.731532 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:04.731542 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:04.731548 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 22:59:04.731712 (+ 164us) client_negotiation.cc:240] Negotiation successful
0805 22:59:04.732040 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":389,"threads_started":1}
I20260805 22:59:04.734823 18157 heartbeater.cc:347] Connected to a master server at 127.20.34.126:44665
I20260805 22:59:04.735209 18157 heartbeater.cc:464] Registering TS with master...
I20260805 22:59:04.736219 18157 heartbeater.cc:511] Master 127.20.34.126:44665 requested a full tablet report, sending...
I20260805 22:59:04.737875 17510 ts_manager.cc:194] Registered new tserver with Master: 53a4eb9b02f649fe8e7b942a3125d324 (127.20.34.67:34153)
I20260805 22:59:04.738713 17510 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.34.67:35289
I20260805 22:59:04.750162 20617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 22:59:04.761106 18160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.754696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53388 (local address 127.20.34.126:44665)
0805 22:59:04.754948 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.754959 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.755380 (+ 421us) server_negotiation.cc:407] Connection header received
0805 22:59:04.755532 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.755536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.755606 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.755694 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:04.756248 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.757204 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.758652 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.759091 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.759190 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.760343 (+ 1153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:04.760348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:04.760351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:04.760372 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:04.760406 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:04.760419 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:04.760491 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.760628 (+ 137us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.760713 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 22:59:04.765751 17510 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 22:59:04.773703 17510 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 22:59:04.803751 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.788326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:36143 (local address 127.0.0.1:36856)
0805 22:59:04.790423 (+ 2097us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:04.790445 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:04.790587 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:04.791927 (+ 1340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:04.791935 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:04.791972 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:04.792521 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.792538 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.795471 (+ 2933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.795481 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.799133 (+ 3652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.799159 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.802451 (+ 3292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.802462 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.802965 (+ 503us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.803066 (+ 101us) client_negotiation.cc:769] Sending connection context
0805 22:59:04.803223 (+ 157us) client_negotiation.cc:240] Negotiation successful
0805 22:59:04.803421 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1949,"mutex_wait_us":148,"thread_start_us":1785,"threads_started":1}
I20260805 22:59:04.804891 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.788012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36856 (local address 127.20.34.66:36143)
0805 22:59:04.788718 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.788730 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.790734 (+ 2004us) server_negotiation.cc:407] Connection header received
0805 22:59:04.790870 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.790878 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.791291 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.791547 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:04.792791 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.795170 (+ 2379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.799491 (+ 4321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.801700 (+ 2209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.801897 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.802271 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.804320 (+ 2049us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.804551 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"spinlock_wait_cycles":23936,"thread_start_us":448,"threads_started":1}
I20260805 22:59:04.806389 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.787753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51618)
0805 22:59:04.788812 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:04.788860 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:04.789007 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:04.791352 (+ 2345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:04.791364 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:04.791410 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:04.791939 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.791956 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.798109 (+ 6153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.798117 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.802847 (+ 4730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.802871 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.805518 (+ 2647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.805525 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.805742 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.805769 (+ 27us) client_negotiation.cc:769] Sending connection context
0805 22:59:04.805888 (+ 119us) client_negotiation.cc:240] Negotiation successful
0805 22:59:04.806026 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"mutex_wait_us":1,"thread_start_us":774,"threads_started":1}
I20260805 22:59:04.806485 18180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.788353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.20.34.65:33549)
0805 22:59:04.790452 (+ 2099us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.790460 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.790495 (+ 35us) server_negotiation.cc:407] Connection header received
0805 22:59:04.790610 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.790621 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.790970 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.792245 (+ 1275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:04.794195 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.796247 (+ 2052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.803154 (+ 6907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.804912 (+ 1758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.805064 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.805381 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.805942 (+ 561us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.806117 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1555,"thread_start_us":1380,"threads_started":1}
I20260805 22:59:04.809744 17871 tablet_service.cc:1467] Processing CreateTablet for tablet 8b54b4d193b342c797828135dbdb8884 (DEFAULT_TABLE table=test-table [id=10ae3d2fab22475dba9ec19613c16caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:59:04.810153 17694 tablet_service.cc:1467] Processing CreateTablet for tablet 8b54b4d193b342c797828135dbdb8884 (DEFAULT_TABLE table=test-table [id=10ae3d2fab22475dba9ec19613c16caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:59:04.811172 17871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b54b4d193b342c797828135dbdb8884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:04.811688 17694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b54b4d193b342c797828135dbdb8884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:04.812008 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.790502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.67:34153 (local address 127.0.0.1:47554)
0805 22:59:04.804033 (+ 13531us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:04.804052 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:04.804167 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:04.804908 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:04.804916 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:04.804949 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:04.805123 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.805133 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.807078 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.807083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.808995 (+ 1912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.809024 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.811169 (+ 2145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.811175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.811381 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.811416 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 22:59:04.811523 (+ 107us) client_negotiation.cc:240] Negotiation successful
0805 22:59:04.811676 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13437,"thread_start_us":14649,"threads_started":1}
I20260805 22:59:04.812518 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.790958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47554 (local address 127.20.34.67:34153)
0805 22:59:04.803577 (+ 12619us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.803587 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.804233 (+ 646us) server_negotiation.cc:407] Connection header received
0805 22:59:04.804355 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.804364 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.804655 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.804910 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:04.805325 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.806899 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.809207 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.810669 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.810848 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.811138 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.811591 (+ 453us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.811918 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12415,"thread_start_us":12235,"threads_started":1}
I20260805 22:59:04.816686 18058 tablet_service.cc:1467] Processing CreateTablet for tablet 8b54b4d193b342c797828135dbdb8884 (DEFAULT_TABLE table=test-table [id=10ae3d2fab22475dba9ec19613c16caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 22:59:04.818368 18058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b54b4d193b342c797828135dbdb8884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:04.824112 18184 tablet_bootstrap.cc:492] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Bootstrap starting.
I20260805 22:59:04.827593 18184 tablet_bootstrap.cc:654] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:04.828219 18185 tablet_bootstrap.cc:492] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: Bootstrap starting.
I20260805 22:59:04.829257 18184 log.cc:824] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:04.832824 18185 tablet_bootstrap.cc:654] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:04.833427 18191 tablet_bootstrap.cc:492] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Bootstrap starting.
I20260805 22:59:04.834251 18185 log.cc:824] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:04.835206 18184 tablet_bootstrap.cc:492] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: No bootstrap required, opened a new log
I20260805 22:59:04.835538 18184 ts_tablet_manager.cc:1397] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260805 22:59:04.837505 18191 tablet_bootstrap.cc:654] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:04.837702 18185 tablet_bootstrap.cc:492] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: No bootstrap required, opened a new log
I20260805 22:59:04.838017 18185 ts_tablet_manager.cc:1397] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260805 22:59:04.838904 18191 log.cc:824] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:04.842465 18191 tablet_bootstrap.cc:492] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: No bootstrap required, opened a new log
I20260805 22:59:04.842764 18191 ts_tablet_manager.cc:1397] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260805 22:59:04.844867 18184 raft_consensus.cc:348] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.845288 18184 raft_consensus.cc:374] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:04.845400 18184 raft_consensus.cc:729] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0436e386824b4075b73499ac7c2e57a7, State: Initialized, Role: FOLLOWER
I20260805 22:59:04.846063 18184 consensus_queue.cc:260] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.847283 17963 heartbeater.cc:503] Master 127.20.34.126:44665 was elected leader, sending a full tablet report...
I20260805 22:59:04.848034 18184 ts_tablet_manager.cc:1428] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260805 22:59:04.848896 18185 raft_consensus.cc:348] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.849376 18185 raft_consensus.cc:374] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:04.849493 18185 raft_consensus.cc:729] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f75655255b4559bc5e5de08d349ef1, State: Initialized, Role: FOLLOWER
I20260805 22:59:04.850167 18185 consensus_queue.cc:260] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.852293 18185 ts_tablet_manager.cc:1428] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
I20260805 22:59:04.854019 18191 raft_consensus.cc:348] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.854552 18191 raft_consensus.cc:374] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:04.854687 18191 raft_consensus.cc:729] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a4eb9b02f649fe8e7b942a3125d324, State: Initialized, Role: FOLLOWER
I20260805 22:59:04.855566 18191 consensus_queue.cc:260] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.856935 18157 heartbeater.cc:503] Master 127.20.34.126:44665 was elected leader, sending a full tablet report...
I20260805 22:59:04.857664 18191 ts_tablet_manager.cc:1428] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Time spent starting tablet: real 0.015s user 0.009s sys 0.005s
I20260805 22:59:04.893056 18199 raft_consensus.cc:482] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 22:59:04.893393 18199 raft_consensus.cc:504] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.895495 18199 leader_election.cc:288] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0436e386824b4075b73499ac7c2e57a7 (127.20.34.66:36143), 33f75655255b4559bc5e5de08d349ef1 (127.20.34.65:33549)
W20260805 22:59:04.897050 17783 tablet.cc:2369] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:04.902901 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.895938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:39381 (local address 127.20.34.66:36143)
0805 22:59:04.896134 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.896138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.896204 (+ 66us) server_negotiation.cc:407] Connection header received
0805 22:59:04.896472 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.896478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.896578 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.896701 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:04.897409 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.898401 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.900494 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.901890 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.902018 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.902072 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.902469 (+ 397us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.902568 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 22:59:04.902936 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.895768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.66:36143 (local address 127.20.34.67:39381)
0805 22:59:04.896060 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:04.896081 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:04.896251 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:04.896925 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:04.896934 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:04.896965 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:04.897199 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.897213 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.898587 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.898593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.900301 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.900315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.902070 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.902078 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.902272 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.902311 (+ 39us) client_negotiation.cc:769] Sending connection context
0805 22:59:04.902435 (+ 124us) client_negotiation.cc:240] Negotiation successful
0805 22:59:04.902590 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260805 22:59:04.903541 18180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.896530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.34.67:48321 (local address 127.20.34.65:33549)
0805 22:59:04.896731 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.896737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.897065 (+ 328us) server_negotiation.cc:407] Connection header received
0805 22:59:04.897226 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.897231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.897334 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.897435 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 22:59:04.898120 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.899103 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.901346 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.902579 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.902757 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.902827 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.903182 (+ 355us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.903308 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 22:59:04.904126 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.896095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.20.34.67:48321)
0805 22:59:04.896944 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:04.896961 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:04.897090 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:04.897472 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:04.897479 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:04.897510 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 22:59:04.897876 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.897890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.899279 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.899283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.900935 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:04.900952 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.902768 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.902774 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:04.902974 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.903007 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 22:59:04.903734 (+ 727us) client_negotiation.cc:240] Negotiation successful
0805 22:59:04.903877 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"spinlock_wait_cycles":1280,"thread_start_us":492,"threads_started":1}
I20260805 22:59:04.904441 17898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b54b4d193b342c797828135dbdb8884" candidate_uuid: "53a4eb9b02f649fe8e7b942a3125d324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0436e386824b4075b73499ac7c2e57a7" is_pre_election: true
I20260805 22:59:04.905143 17898 raft_consensus.cc:2454] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a4eb9b02f649fe8e7b942a3125d324 in term 0.
I20260805 22:59:04.905372 17720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b54b4d193b342c797828135dbdb8884" candidate_uuid: "53a4eb9b02f649fe8e7b942a3125d324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f75655255b4559bc5e5de08d349ef1" is_pre_election: true
I20260805 22:59:04.905949 17997 leader_election.cc:302] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0436e386824b4075b73499ac7c2e57a7, 53a4eb9b02f649fe8e7b942a3125d324; no voters:
I20260805 22:59:04.905962 17720 raft_consensus.cc:2454] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a4eb9b02f649fe8e7b942a3125d324 in term 0.
I20260805 22:59:04.906378 18199 raft_consensus.cc:2781] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 22:59:04.906589 18199 raft_consensus.cc:482] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 22:59:04.906714 18199 raft_consensus.cc:3037] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:04.909214 18199 raft_consensus.cc:504] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.909868 18199 leader_election.cc:288] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [CANDIDATE]: Term 1 election: Requested vote from peers 0436e386824b4075b73499ac7c2e57a7 (127.20.34.66:36143), 33f75655255b4559bc5e5de08d349ef1 (127.20.34.65:33549)
W20260805 22:59:04.910318 17966 tablet.cc:2369] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:04.910470 17720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b54b4d193b342c797828135dbdb8884" candidate_uuid: "53a4eb9b02f649fe8e7b942a3125d324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f75655255b4559bc5e5de08d349ef1"
I20260805 22:59:04.910481 17898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b54b4d193b342c797828135dbdb8884" candidate_uuid: "53a4eb9b02f649fe8e7b942a3125d324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0436e386824b4075b73499ac7c2e57a7"
I20260805 22:59:04.910707 17720 raft_consensus.cc:3037] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:04.910735 17898 raft_consensus.cc:3037] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:04.913201 17898 raft_consensus.cc:2454] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a4eb9b02f649fe8e7b942a3125d324 in term 1.
I20260805 22:59:04.913201 17720 raft_consensus.cc:2454] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a4eb9b02f649fe8e7b942a3125d324 in term 1.
I20260805 22:59:04.913697 17997 leader_election.cc:302] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0436e386824b4075b73499ac7c2e57a7, 53a4eb9b02f649fe8e7b942a3125d324; no voters:
I20260805 22:59:04.914054 18199 raft_consensus.cc:2781] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:04.914526 18199 raft_consensus.cc:686] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 1 LEADER]: Becoming Leader. State: Replica: 53a4eb9b02f649fe8e7b942a3125d324, State: Running, Role: LEADER
I20260805 22:59:04.915134 18199 consensus_queue.cc:237] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } }
I20260805 22:59:04.920768 17510 catalog_manager.cc:5495] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a4eb9b02f649fe8e7b942a3125d324 (127.20.34.67). New cstate: current_term: 1 leader_uuid: "53a4eb9b02f649fe8e7b942a3125d324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a4eb9b02f649fe8e7b942a3125d324" member_type: VOTER last_known_addr { host: "127.20.34.67" port: 34153 } health_report { overall_health: HEALTHY } } }
I20260805 22:59:04.958448 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:04.952813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.20.34.67:34153)
0805 22:59:04.953053 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:04.953060 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:04.953123 (+ 63us) server_negotiation.cc:407] Connection header received
0805 22:59:04.953361 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:04.953365 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:04.953459 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:04.953619 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:04.954014 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.954779 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.956194 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:04.956622 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:04.956763 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:04.957291 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:04.957817 (+ 526us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:04.957980 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:04.958082 (+ 102us) server_negotiation.cc:299] Negotiation successful
0805 22:59:04.958168 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260805 22:59:04.967310 17898 raft_consensus.cc:1261] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 1 FOLLOWER]: Refusing update from remote peer 53a4eb9b02f649fe8e7b942a3125d324: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:59:04.967368 17720 raft_consensus.cc:1261] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 1 FOLLOWER]: Refusing update from remote peer 53a4eb9b02f649fe8e7b942a3125d324: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:59:04.968580 18201 consensus_queue.cc:1035] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33f75655255b4559bc5e5de08d349ef1" member_type: VOTER last_known_addr { host: "127.20.34.65" port: 33549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:59:04.968966 18199 consensus_queue.cc:1035] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0436e386824b4075b73499ac7c2e57a7" member_type: VOTER last_known_addr { host: "127.20.34.66" port: 36143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 22:59:04.969907 18159 tablet.cc:2369] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:05.000607 17501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:59:05.000965 17501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 22:59:05.005121 17501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P decea54b70bf4323af29a4ce2546c389: Sending DeleteTablet for 3 replicas of tablet 8b54b4d193b342c797828135dbdb8884
I20260805 22:59:05.006644 17694 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b54b4d193b342c797828135dbdb8884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:59:04 UTC) from {username='slave'} at 127.0.0.1:51618
I20260805 22:59:05.006644 17871 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b54b4d193b342c797828135dbdb8884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:59:04 UTC) from {username='slave'} at 127.0.0.1:36856
I20260805 22:59:05.007825 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 17605
I20260805 22:59:05.007752 18058 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b54b4d193b342c797828135dbdb8884 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 22:59:04 UTC) from {username='slave'} at 127.0.0.1:47554
I20260805 22:59:05.019898 18223 tablet_replica.cc:330] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: stopping tablet replica
I20260805 22:59:05.021137 18222 tablet_replica.cc:330] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: stopping tablet replica
I20260805 22:59:05.021757 18222 raft_consensus.cc:2229] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:59:05.022460 18222 raft_consensus.cc:2258] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:59:05.023102 18223 raft_consensus.cc:2229] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 22:59:05.023702 18223 raft_consensus.cc:2258] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:59:05.024276 18230 tablet_replica.cc:330] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: stopping tablet replica
I20260805 22:59:05.025270 18230 raft_consensus.cc:2229] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 1 LEADER]: Raft consensus shutting down.
I20260805 22:59:05.026165 18230 raft_consensus.cc:2258] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 22:59:05.027779 18222 ts_tablet_manager.cc:1905] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:59:05.029503 18230 ts_tablet_manager.cc:1905] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:59:05.035148 18222 ts_tablet_manager.cc:1918] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:59:05.035326 18222 log.cc:1196] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-1/wal/wals/8b54b4d193b342c797828135dbdb8884
I20260805 22:59:05.035881 18222 ts_tablet_manager.cc:1939] T 8b54b4d193b342c797828135dbdb8884 P 0436e386824b4075b73499ac7c2e57a7: Deleting consensus metadata
I20260805 22:59:05.037938 17488 catalog_manager.cc:4841] TS 0436e386824b4075b73499ac7c2e57a7 (127.20.34.66:36143): tablet 8b54b4d193b342c797828135dbdb8884 (table test-table [id=10ae3d2fab22475dba9ec19613c16caa]) successfully deleted
I20260805 22:59:05.038594 18180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.010046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.20.34.65:33549)
0805 22:59:05.010258 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:05.010264 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:05.020833 (+ 10569us) server_negotiation.cc:407] Connection header received
0805 22:59:05.021092 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:05.021099 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:05.021228 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:05.021331 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:05.022151 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:05.023437 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:05.025523 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:05.026179 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:05.026297 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:05.036466 (+ 10169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:05.036484 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:05.036505 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:05.037388 (+ 883us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:05.037469 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:05.037504 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:05.037621 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:05.037996 (+ 375us) server_negotiation.cc:299] Negotiation successful
0805 22:59:05.038159 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 22:59:05.038630 18223 ts_tablet_manager.cc:1905] T 8b54b4d193b342c797828135dbdb8884 P 33f75655255b4559bc5e5de08d349ef1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 22:59:05.039991 17774 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:05.041365 18230 ts_tablet_manager.cc:1918] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 22:59:05.041675 18230 log.cc:1196] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Deleting WAL directory at /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970399628623-20617-0/minicluster-data/ts-2/wal/wals/8b54b4d193b342c797828135dbdb8884
I20260805 22:59:05.042383 18230 ts_tablet_manager.cc:1939] T 8b54b4d193b342c797828135dbdb8884 P 53a4eb9b02f649fe8e7b942a3125d324: Deleting consensus metadata
I20260805 22:59:05.044520 17488 catalog_manager.cc:4841] TS 53a4eb9b02f649fe8e7b942a3125d324 (127.20.34.67:34153): tablet 8b54b4d193b342c797828135dbdb8884 (table test-table [id=10ae3d2fab22475dba9ec19613c16caa]) successfully deleted
I20260805 22:59:05.144985 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 17605
W20260805 22:59:05.178630 17486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.34.65:33549 (error 108)
I20260805 22:59:05.179477 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 17786
I20260805 22:59:05.188387 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.187726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51638)
0805 22:59:05.188015 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:05.188142 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
W20260805 22:59:05.188819 17486 catalog_manager.cc:4584] TS 33f75655255b4559bc5e5de08d349ef1 (127.20.34.65:33549): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b54b4d193b342c797828135dbdb8884: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
I20260805 22:59:05.192059 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.180427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36860 (local address 127.20.34.66:36143)
0805 22:59:05.181073 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:05.181079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:05.181100 (+ 21us) server_negotiation.cc:407] Connection header received
0805 22:59:05.181163 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:05.181168 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:05.181337 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:05.181453 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:05.182144 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:05.183381 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:05.185484 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:05.186189 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:05.186310 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:05.189667 (+ 3357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:05.189679 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:05.189698 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:05.190504 (+ 806us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:05.190569 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:05.190604 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:05.190714 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:05.191461 (+ 747us) server_negotiation.cc:299] Negotiation successful
0805 22:59:05.191633 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500}
I20260805 22:59:05.192857 17956 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:05.242533 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.242021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51644)
0805 22:59:05.242277 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:05.242370 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260805 22:59:05.243718 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.243321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51648)
0805 22:59:05.243495 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:05.243573 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260805 22:59:05.304468 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.303917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51660)
0805 22:59:05.304201 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:05.304315 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260805 22:59:05.305706 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.305308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51664)
0805 22:59:05.305476 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:05.305561 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260805 22:59:05.337386 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 17786
I20260805 22:59:05.362977 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 17970
I20260805 22:59:05.371873 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.363953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47580 (local address 127.20.34.67:34153)
0805 22:59:05.364180 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:05.364186 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:05.364219 (+ 33us) server_negotiation.cc:407] Connection header received
0805 22:59:05.364392 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:05.364399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:05.364536 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:05.364679 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:05.365118 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:05.366405 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:05.367938 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:05.368747 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:05.368906 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:05.370109 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:05.370123 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:05.370145 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:05.370982 (+ 837us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:05.371059 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:05.371085 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:05.371208 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:05.371347 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 22:59:05.371475 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 22:59:05.372727 18150 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:05.386816 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.386294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51680)
0805 22:59:05.386548 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:05.386650 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260805 22:59:05.388062 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.387630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51686)
0805 22:59:05.387852 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:05.387942 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260805 22:59:05.502362 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 17970
I20260805 22:59:05.531921 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 17462
I20260805 22:59:05.533193 17557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:05.648214 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:05.647532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.65:33549 (local address 127.0.0.1:51698)
0805 22:59:05.647819 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:05.647946 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.65:33549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260805 22:59:05.648267 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 17462
2026-08-05T22:59:05Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3204 ms)
[----------] 6 tests from EncryptionPolicyTest (24888 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:05 dist-test-slave-gmjp krb5kdc[18249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:05 dist-test-slave-gmjp krb5kdc[18249](info): set up 2 sockets
Aug 05 22:59:05 dist-test-slave-gmjp krb5kdc[18249](info): commencing operation
krb5kdc: starting...
W20260805 22:59:07.007758 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.004s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:07 dist-test-slave-gmjp krb5kdc[18249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:07.389135 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44807
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:07.773316 18274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:07.773654 18274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:07.773823 18274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:07.781510 18274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:07.781647 18274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:07.781782 18274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:07.781901 18274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:07.781970 18274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:07.792781 18274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44807
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:07.794297 18274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:07.795842 18274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:07.808772 18283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:07.808868 18285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:07.808866 18288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:07.810266 18274 server_base.cc:1034] running on GCE node
I20260805 22:59:07.811339 18274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:07.813079 18274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:07.814344 18274 hybrid_clock.cc:648] HybridClock initialized: now 1785970747814288 us; error 51 us; skew 500 ppm
I20260805 22:59:07.814774 18274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:07 dist-test-slave-gmjp krb5kdc[18249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:07.818305 18274 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:07.819998 18274 webserver.cc:460] Webserver started at http://127.0.0.1:39597/ using document root <none> and password file <none>
I20260805 22:59:07.820824 18274 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:07.820983 18274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:07.821328 18274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:07.824630 18274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "2a4436acfc5d4200a86c05e3fbf370f9"
format_stamp: "Formatted at 2026-08-05 22:59:07 on dist-test-slave-gmjp"
server_key: "044ff3cc5ca3be2eacc3158602899d20"
server_key_iv: "d7d80a3cb57c5d3f5170d39db1f56761"
server_key_version: "encryptionkey@0"
I20260805 22:59:07.825551 18274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "2a4436acfc5d4200a86c05e3fbf370f9"
format_stamp: "Formatted at 2026-08-05 22:59:07 on dist-test-slave-gmjp"
server_key: "044ff3cc5ca3be2eacc3158602899d20"
server_key_iv: "d7d80a3cb57c5d3f5170d39db1f56761"
server_key_version: "encryptionkey@0"
I20260805 22:59:07.831367 18274 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 22:59:07.835114 18296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:07.836630 18274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:59:07.836841 18274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "2a4436acfc5d4200a86c05e3fbf370f9"
format_stamp: "Formatted at 2026-08-05 22:59:07 on dist-test-slave-gmjp"
server_key: "044ff3cc5ca3be2eacc3158602899d20"
server_key_iv: "d7d80a3cb57c5d3f5170d39db1f56761"
server_key_version: "encryptionkey@0"
I20260805 22:59:07.837062 18274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:07.853458 18274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:07.858203 18274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:07.858570 18274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:07.878587 18274 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44807
I20260805 22:59:07.878618 18372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44807 every 8 connection(s)
I20260805 22:59:07.880316 18274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:07.884297 18373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:07.887715 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 18274
I20260805 22:59:07.887972 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:07.888929 20617 external_mini_cluster.cc:1428] Setting key 2e65d9e67689940486e93fac28a3b70a
I20260805 22:59:07.897840 18373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9: Bootstrap starting.
I20260805 22:59:07.901376 18373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:07.902549 18373 log.cc:824] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9: Log is configured to *not* fsync() on all Append() calls
Aug 05 22:59:07 dist-test-slave-gmjp krb5kdc[18249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:59:07.906383 18373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9: No bootstrap required, opened a new log
I20260805 22:59:07.915947 18377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:07.891255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57221 (local address 127.0.0.1:44807)
0805 22:59:07.892270 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:07.892283 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:07.892332 (+ 49us) server_negotiation.cc:407] Connection header received
0805 22:59:07.894152 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:07.894178 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:07.894657 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:07.895154 (+ 497us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:07.896908 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:07.898350 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:07.899850 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:07.900642 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:07.900880 (+ 238us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:07.905893 (+ 5013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:07.905906 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:07.905927 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:07.905975 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:07.910433 (+ 4458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:07.911451 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:07.911463 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:07.911474 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:07.911724 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:07.912259 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:07.912265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:07.912268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:07.913131 (+ 863us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:07.913498 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:07.913942 (+ 444us) server_negotiation.cc:299] Negotiation successful
0805 22:59:07.914369 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":425,"threads_started":1}
I20260805 22:59:07.917918 18373 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4436acfc5d4200a86c05e3fbf370f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44807 } }
I20260805 22:59:07.918467 18373 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:07.918597 18373 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4436acfc5d4200a86c05e3fbf370f9, State: Initialized, Role: FOLLOWER
I20260805 22:59:07.919312 18373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4436acfc5d4200a86c05e3fbf370f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44807 } }
I20260805 22:59:07.919618 18373 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:07.919801 18373 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:07.920001 18373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:07.920969 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:07.923772 18373 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4436acfc5d4200a86c05e3fbf370f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44807 } }
I20260805 22:59:07.924480 18373 leader_election.cc:302] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a4436acfc5d4200a86c05e3fbf370f9; no voters:
I20260805 22:59:07.925273 18373 leader_election.cc:288] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:07.925432 18384 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:07.927964 18373 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:07.928399 18384 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [term 1 LEADER]: Becoming Leader. State: Replica: 2a4436acfc5d4200a86c05e3fbf370f9, State: Running, Role: LEADER
I20260805 22:59:07.929042 18384 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4436acfc5d4200a86c05e3fbf370f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44807 } }
I20260805 22:59:07.932330 18390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a4436acfc5d4200a86c05e3fbf370f9. Latest consensus state: current_term: 1 leader_uuid: "2a4436acfc5d4200a86c05e3fbf370f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4436acfc5d4200a86c05e3fbf370f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44807 } } }
I20260805 22:59:07.932721 18390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:07.934055 18389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a4436acfc5d4200a86c05e3fbf370f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4436acfc5d4200a86c05e3fbf370f9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44807 } } }
I20260805 22:59:07.934446 18389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:07.942530 18401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:07.949295 18401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:07.953605 18377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:07.927433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47981 (local address 127.0.0.1:44807)
0805 22:59:07.927628 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:07.927633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:07.928338 (+ 705us) server_negotiation.cc:407] Connection header received
0805 22:59:07.928646 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:07.928652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:07.928746 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:07.928828 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:07.931992 (+ 3164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:07.933700 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:07.936656 (+ 2956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:07.937527 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:07.937677 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:07.942978 (+ 5301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:07.942990 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:07.942999 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:07.943064 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:07.948312 (+ 5248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:07.949785 (+ 1473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:07.949794 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:07.949801 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:07.950007 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:07.950814 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:07.950823 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:07.950829 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:07.951478 (+ 649us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:07.951841 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:07.952836 (+ 995us) server_negotiation.cc:299] Negotiation successful
0805 22:59:07.953086 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 22:59:07.961570 18401 catalog_manager.cc:1347] Generated new cluster ID: 5a39767eb31d4ee38d85d68e320e087c
I20260805 22:59:07.961694 18401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:07.965816 18416 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:59:07.975436 18401 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:07.976940 18401 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:07.991326 18401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a4436acfc5d4200a86c05e3fbf370f9: Generated new TSK 0
I20260805 22:59:07.992527 18401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:08.007001 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 18274
I20260805 22:59:08.008631 18368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:08.104518 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 18274
W20260805 22:59:08.132452 18245 connection.cc:535] client connection to 127.0.0.1:44807 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44807): Connection reset by peer (error 104)
2026-08-05T22:59:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:08 dist-test-slave-gmjp krb5kdc[18420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:08 dist-test-slave-gmjp krb5kdc[18420](info): set up 2 sockets
Aug 05 22:59:08 dist-test-slave-gmjp krb5kdc[18420](info): commencing operation
krb5kdc: starting...
W20260805 22:59:09.471215 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.319s user 0.002s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:09 dist-test-slave-gmjp krb5kdc[18420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:09.852656 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38409
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:10.218554 18441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:10.218856 18441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:10.218951 18441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:10.226426 18441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:10.226572 18441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:10.226619 18441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:10.226681 18441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:10.226727 18441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:10.237185 18441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38409
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:10.238603 18441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:10.239920 18441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:10.253034 18454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:10.253065 18457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:10.253034 18452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:10.254448 18441 server_base.cc:1034] running on GCE node
I20260805 22:59:10.255401 18441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:10.257171 18441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:10.258447 18441 hybrid_clock.cc:648] HybridClock initialized: now 1785970750258390 us; error 68 us; skew 500 ppm
I20260805 22:59:10.258853 18441 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:10 dist-test-slave-gmjp krb5kdc[18420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970750, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:10.266136 18441 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:10.267951 18441 webserver.cc:460] Webserver started at http://127.0.0.1:45721/ using document root <none> and password file <none>
I20260805 22:59:10.268821 18441 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:10.268996 18441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:10.269342 18441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:10.272883 18441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "40104ff4876649f695f2d28e6d26e69f"
format_stamp: "Formatted at 2026-08-05 22:59:10 on dist-test-slave-gmjp"
server_key: "8db03fea5d4dbf279ac069e4a9f7262b"
server_key_iv: "58d6a0ed18e5cfbe3fedf18849460684"
server_key_version: "encryptionkey@0"
I20260805 22:59:10.273764 18441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "40104ff4876649f695f2d28e6d26e69f"
format_stamp: "Formatted at 2026-08-05 22:59:10 on dist-test-slave-gmjp"
server_key: "8db03fea5d4dbf279ac069e4a9f7262b"
server_key_iv: "58d6a0ed18e5cfbe3fedf18849460684"
server_key_version: "encryptionkey@0"
I20260805 22:59:10.279942 18441 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 22:59:10.283934 18471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:10.285539 18441 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:59:10.285772 18441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "40104ff4876649f695f2d28e6d26e69f"
format_stamp: "Formatted at 2026-08-05 22:59:10 on dist-test-slave-gmjp"
server_key: "8db03fea5d4dbf279ac069e4a9f7262b"
server_key_iv: "58d6a0ed18e5cfbe3fedf18849460684"
server_key_version: "encryptionkey@0"
I20260805 22:59:10.286028 18441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:10.323016 18441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:10.327605 18441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:10.327944 18441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:10.348259 18441 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38409
I20260805 22:59:10.348263 18550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38409 every 8 connection(s)
I20260805 22:59:10.349822 18441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:10.351584 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 18441
I20260805 22:59:10.351806 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:10.352355 20617 external_mini_cluster.cc:1428] Setting key a79a15c07767950db0ea43ce83dd0c01
I20260805 22:59:10.354506 18551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:10.367043 18554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:10.354245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55465 (local address 127.0.0.1:38409)
0805 22:59:10.355137 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:10.355151 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:10.355197 (+ 46us) server_negotiation.cc:407] Connection header received
0805 22:59:10.356989 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:10.357016 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:10.357483 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:10.357879 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:10.358657 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:10.360058 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:10.362077 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:10.362784 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:10.362957 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:10.364480 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:10.364488 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:10.364505 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:10.365125 (+ 620us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:10.365206 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:10.365240 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:10.365377 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:10.365751 (+ 374us) server_negotiation.cc:299] Negotiation successful
0805 22:59:10.365990 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":400,"threads_started":1}
I20260805 22:59:10.368527 18551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f: Bootstrap starting.
I20260805 22:59:10.371578 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:10.372243 18551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:10.373335 18551 log.cc:824] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:10.376919 18551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f: No bootstrap required, opened a new log
I20260805 22:59:10.384256 18554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:10.376538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60423 (local address 127.0.0.1:38409)
0805 22:59:10.376764 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:10.376770 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:10.377208 (+ 438us) server_negotiation.cc:407] Connection header received
0805 22:59:10.377398 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:10.377403 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:10.377499 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:10.377642 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:10.378160 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:10.379388 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:10.381075 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:10.381799 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:10.381944 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:10.383301 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:10.383311 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:10.383316 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:10.383348 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:10.383416 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:10.383442 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:10.383575 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:10.383767 (+ 192us) server_negotiation.cc:299] Negotiation successful
0805 22:59:10.383834 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260805 22:59:10.387111 18551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40104ff4876649f695f2d28e6d26e69f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38409 } }
I20260805 22:59:10.387530 18551 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:10.387615 18551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40104ff4876649f695f2d28e6d26e69f, State: Initialized, Role: FOLLOWER
I20260805 22:59:10.388268 18551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40104ff4876649f695f2d28e6d26e69f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38409 } }
I20260805 22:59:10.388543 18551 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:10.388728 18551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:10.388954 18551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:10.391608 18551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40104ff4876649f695f2d28e6d26e69f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38409 } }
I20260805 22:59:10.392199 18551 leader_election.cc:302] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40104ff4876649f695f2d28e6d26e69f; no voters:
I20260805 22:59:10.392814 18551 leader_election.cc:288] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:10.393033 18568 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:10.393743 18568 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [term 1 LEADER]: Becoming Leader. State: Replica: 40104ff4876649f695f2d28e6d26e69f, State: Running, Role: LEADER
I20260805 22:59:10.394402 18568 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40104ff4876649f695f2d28e6d26e69f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38409 } }
I20260805 22:59:10.395303 18551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:10.398006 18570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40104ff4876649f695f2d28e6d26e69f. Latest consensus state: current_term: 1 leader_uuid: "40104ff4876649f695f2d28e6d26e69f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40104ff4876649f695f2d28e6d26e69f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38409 } } }
I20260805 22:59:10.398432 18570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:10.400291 18576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:10.400053 18569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40104ff4876649f695f2d28e6d26e69f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40104ff4876649f695f2d28e6d26e69f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38409 } } }
I20260805 22:59:10.400671 18569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:10.407940 18576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:10.417631 18576 catalog_manager.cc:1347] Generated new cluster ID: 6b71c37863ac4a3c917de7eff299ea74
I20260805 22:59:10.417781 18576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:10.432868 18576 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:10.434867 18576 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:10.441885 18576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40104ff4876649f695f2d28e6d26e69f: Generated new TSK 0
I20260805 22:59:10.443123 18576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:10.461128 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 18441
W20260805 22:59:10.462520 18544 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55465
W20260805 22:59:10.463416 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 18441: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:10.463631 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 18441
W20260805 22:59:10.488078 18418 connection.cc:535] client connection to 127.0.0.1:38409 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38409): Connection reset by peer (error 104)
2026-08-05T22:59:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2355 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:10 dist-test-slave-gmjp krb5kdc[18592](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:10 dist-test-slave-gmjp krb5kdc[18592](info): set up 2 sockets
Aug 05 22:59:10 dist-test-slave-gmjp krb5kdc[18592](info): commencing operation
krb5kdc: starting...
W20260805 22:59:11.804742 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.297s user 0.007s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:12 dist-test-slave-gmjp krb5kdc[18592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970752, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:12.183568 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36871
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:12.554390 18614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:12.554750 18614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:12.554931 18614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:12.562779 18614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:12.562956 18614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:12.563060 18614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:12.563169 18614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:12.563251 18614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:12.575166 18614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36871
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:12.576759 18614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:12.578271 18614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:12.590657 18623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:12.590745 18626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:12.590716 18629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:12.591797 18614 server_base.cc:1034] running on GCE node
I20260805 22:59:12.592741 18614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:12.594307 18614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:12.595546 18614 hybrid_clock.cc:648] HybridClock initialized: now 1785970752595498 us; error 37 us; skew 500 ppm
I20260805 22:59:12.595950 18614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:12 dist-test-slave-gmjp krb5kdc[18592](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970752, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:12.599432 18614 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:12.601125 18614 webserver.cc:460] Webserver started at http://127.0.0.1:34259/ using document root <none> and password file <none>
I20260805 22:59:12.601862 18614 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:12.602002 18614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:12.602344 18614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:12.605672 18614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "35ce9418272a4df5894461885fddbc39"
format_stamp: "Formatted at 2026-08-05 22:59:12 on dist-test-slave-gmjp"
server_key: "20c9780c7f95f6ed472096f46906a1f6"
server_key_iv: "4f3101f31dcdbc39d16b860118cf6f22"
server_key_version: "encryptionkey@0"
I20260805 22:59:12.606549 18614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "35ce9418272a4df5894461885fddbc39"
format_stamp: "Formatted at 2026-08-05 22:59:12 on dist-test-slave-gmjp"
server_key: "20c9780c7f95f6ed472096f46906a1f6"
server_key_iv: "4f3101f31dcdbc39d16b860118cf6f22"
server_key_version: "encryptionkey@0"
I20260805 22:59:12.612354 18614 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:59:12.616096 18645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:12.617514 18614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:59:12.617710 18614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "35ce9418272a4df5894461885fddbc39"
format_stamp: "Formatted at 2026-08-05 22:59:12 on dist-test-slave-gmjp"
server_key: "20c9780c7f95f6ed472096f46906a1f6"
server_key_iv: "4f3101f31dcdbc39d16b860118cf6f22"
server_key_version: "encryptionkey@0"
I20260805 22:59:12.617945 18614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:12.624099 18614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:12.628484 18614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:12.628794 18614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:12.648864 18614 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36871
I20260805 22:59:12.648903 18722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36871 every 8 connection(s)
I20260805 22:59:12.650449 18614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:12.650825 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 18614
I20260805 22:59:12.651023 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:12.651538 20617 external_mini_cluster.cc:1428] Setting key 0ae3522655bfdcc76d0abcde432c8bdc
I20260805 22:59:12.655858 18723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:12.661893 18726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:12.653685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38687 (local address 127.0.0.1:36871)
0805 22:59:12.654563 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:12.654581 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:12.654640 (+ 59us) server_negotiation.cc:407] Connection header received
0805 22:59:12.657323 (+ 2683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:12.657370 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:12.657893 (+ 523us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:12.658423 (+ 530us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:12.659593 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:12.659603 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:12.659623 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:12.659646 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:12.659763 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:12.659797 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:12.660051 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:12.660242 (+ 191us) server_negotiation.cc:299] Negotiation successful
0805 22:59:12.660476 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":360,"threads_started":1}
I20260805 22:59:12.666675 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:12.672428 18723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39: Bootstrap starting.
I20260805 22:59:12.674638 18726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:12.671583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41819 (local address 127.0.0.1:36871)
0805 22:59:12.671759 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:12.671764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:12.672342 (+ 578us) server_negotiation.cc:407] Connection header received
0805 22:59:12.672579 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:12.672583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:12.672667 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:12.672792 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:12.673875 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:12.673880 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:12.673884 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:12.673901 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:12.673964 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:12.673981 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:12.674143 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:12.674259 (+ 116us) server_negotiation.cc:299] Negotiation successful
0805 22:59:12.674327 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 22:59:12.677233 18723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:12.678494 18723 log.cc:824] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:12.682006 18723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39: No bootstrap required, opened a new log
I20260805 22:59:12.690210 18723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ce9418272a4df5894461885fddbc39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36871 } }
I20260805 22:59:12.690640 18723 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:12.690718 18723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35ce9418272a4df5894461885fddbc39, State: Initialized, Role: FOLLOWER
I20260805 22:59:12.691334 18723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ce9418272a4df5894461885fddbc39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36871 } }
I20260805 22:59:12.691566 18723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:12.691728 18723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:12.691936 18723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:12.694453 18723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ce9418272a4df5894461885fddbc39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36871 } }
I20260805 22:59:12.695072 18723 leader_election.cc:302] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35ce9418272a4df5894461885fddbc39; no voters:
I20260805 22:59:12.695689 18723 leader_election.cc:288] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:12.695894 18736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:12.696617 18736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [term 1 LEADER]: Becoming Leader. State: Replica: 35ce9418272a4df5894461885fddbc39, State: Running, Role: LEADER
I20260805 22:59:12.697189 18736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ce9418272a4df5894461885fddbc39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36871 } }
I20260805 22:59:12.697983 18723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:12.700258 18739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35ce9418272a4df5894461885fddbc39. Latest consensus state: current_term: 1 leader_uuid: "35ce9418272a4df5894461885fddbc39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ce9418272a4df5894461885fddbc39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36871 } } }
I20260805 22:59:12.700805 18739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:12.701399 18738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35ce9418272a4df5894461885fddbc39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35ce9418272a4df5894461885fddbc39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36871 } } }
I20260805 22:59:12.701762 18738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:12.707726 18745 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:12.712731 18745 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:12.721635 18745 catalog_manager.cc:1347] Generated new cluster ID: 37b68be8687b433e99358f02030da21a
I20260805 22:59:12.721769 18745 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:12.748248 18745 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:12.748723 18745 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:12.758231 18745 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35ce9418272a4df5894461885fddbc39: Generated new TSK 0
I20260805 22:59:12.759186 18745 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:12.777714 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 18614
W20260805 22:59:12.779352 18718 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38687
W20260805 22:59:12.780273 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 18614: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:12.780459 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 18614
2026-08-05T22:59:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:12 dist-test-slave-gmjp krb5kdc[18761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:12 dist-test-slave-gmjp krb5kdc[18761](info): set up 2 sockets
Aug 05 22:59:12 dist-test-slave-gmjp krb5kdc[18761](info): commencing operation
krb5kdc: starting...
W20260805 22:59:14.138782 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.004s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:14 dist-test-slave-gmjp krb5kdc[18761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:14.516610 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46275
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:14.885933 18781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:14.886263 18781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:14.886441 18781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:14.894168 18781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:14.894316 18781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:14.894368 18781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:14.894465 18781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:14.894553 18781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:14.905081 18781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:14.906538 18781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:14.907948 18781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:14.920630 18790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:14.920547 18797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:14.920581 18791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:14.921708 18781 server_base.cc:1034] running on GCE node
I20260805 22:59:14.922632 18781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:14.924224 18781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:14.925472 18781 hybrid_clock.cc:648] HybridClock initialized: now 1785970754925425 us; error 54 us; skew 500 ppm
I20260805 22:59:14.925905 18781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:14 dist-test-slave-gmjp krb5kdc[18761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970754, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:14.929512 18781 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:14.931177 18781 webserver.cc:460] Webserver started at http://127.0.0.1:38069/ using document root <none> and password file <none>
I20260805 22:59:14.931950 18781 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:14.932063 18781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:14.932411 18781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:14.935686 18781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "1c32840131a141119fe56ad1d93e72bf"
format_stamp: "Formatted at 2026-08-05 22:59:14 on dist-test-slave-gmjp"
server_key: "93038131552b72ebaf0e462a7a06d74b"
server_key_iv: "aea7be7427e1f072da6e73cb5caac6fe"
server_key_version: "encryptionkey@0"
I20260805 22:59:14.936574 18781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "1c32840131a141119fe56ad1d93e72bf"
format_stamp: "Formatted at 2026-08-05 22:59:14 on dist-test-slave-gmjp"
server_key: "93038131552b72ebaf0e462a7a06d74b"
server_key_iv: "aea7be7427e1f072da6e73cb5caac6fe"
server_key_version: "encryptionkey@0"
I20260805 22:59:14.942202 18781 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:59:14.946007 18809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:14.947587 18781 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:59:14.947758 18781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "1c32840131a141119fe56ad1d93e72bf"
format_stamp: "Formatted at 2026-08-05 22:59:14 on dist-test-slave-gmjp"
server_key: "93038131552b72ebaf0e462a7a06d74b"
server_key_iv: "aea7be7427e1f072da6e73cb5caac6fe"
server_key_version: "encryptionkey@0"
I20260805 22:59:14.947954 18781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:14.964309 18781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:14.969208 18781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:14.969475 18781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:14.989903 18781 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46275
I20260805 22:59:14.989923 18877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46275 every 8 connection(s)
I20260805 22:59:14.991534 18781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:14.994370 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 18781
I20260805 22:59:14.994589 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:14.995152 20617 external_mini_cluster.cc:1428] Setting key b929ab1b7f0158c185246c00502cfd61
I20260805 22:59:14.996479 18879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 22:59:15 dist-test-slave-gmjp krb5kdc[18761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:59:15.011706 18879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf: Bootstrap starting.
I20260805 22:59:15.016500 18879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:15.017799 18879 log.cc:824] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:15.021692 18879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf: No bootstrap required, opened a new log
I20260805 22:59:15.022029 18885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:14.997121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50947 (local address 127.0.0.1:46275)
0805 22:59:14.997974 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:14.997990 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:14.998045 (+ 55us) server_negotiation.cc:407] Connection header received
0805 22:59:15.000136 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:15.000168 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:15.000765 (+ 597us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:15.001254 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:15.002718 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:15.004883 (+ 2165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:15.006244 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:15.007377 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:15.007582 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:15.012483 (+ 4901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:15.012496 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:15.012519 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:15.012577 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:15.017003 (+ 4426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:15.017932 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:15.017942 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:15.017951 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:15.018190 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:15.018707 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:15.018710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:15.018712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:15.019333 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:15.019637 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:15.020088 (+ 451us) server_negotiation.cc:299] Negotiation successful
0805 22:59:15.020598 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":361,"threads_started":1}
I20260805 22:59:15.026386 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:15.032346 18879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c32840131a141119fe56ad1d93e72bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46275 } }
I20260805 22:59:15.032930 18879 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:15.033073 18879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c32840131a141119fe56ad1d93e72bf, State: Initialized, Role: FOLLOWER
I20260805 22:59:15.033876 18879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c32840131a141119fe56ad1d93e72bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46275 } }
I20260805 22:59:15.034202 18879 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:15.034377 18879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:15.034598 18879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:15.037914 18879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c32840131a141119fe56ad1d93e72bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46275 } }
I20260805 22:59:15.038623 18879 leader_election.cc:302] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c32840131a141119fe56ad1d93e72bf; no voters:
I20260805 22:59:15.039407 18879 leader_election.cc:288] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:15.039527 18893 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:15.040391 18893 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [term 1 LEADER]: Becoming Leader. State: Replica: 1c32840131a141119fe56ad1d93e72bf, State: Running, Role: LEADER
I20260805 22:59:15.041091 18893 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c32840131a141119fe56ad1d93e72bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46275 } }
I20260805 22:59:15.043565 18894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c32840131a141119fe56ad1d93e72bf. Latest consensus state: current_term: 1 leader_uuid: "1c32840131a141119fe56ad1d93e72bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c32840131a141119fe56ad1d93e72bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46275 } } }
I20260805 22:59:15.044129 18894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:15.044224 18895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c32840131a141119fe56ad1d93e72bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c32840131a141119fe56ad1d93e72bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46275 } } }
I20260805 22:59:15.044665 18895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:15.045574 18879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:15.050165 18897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:15.051563 18885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:15.032035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48497 (local address 127.0.0.1:46275)
0805 22:59:15.032266 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:15.032273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:15.032868 (+ 595us) server_negotiation.cc:407] Connection header received
0805 22:59:15.033102 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:15.033107 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:15.033202 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:15.033299 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:15.035504 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:15.036439 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:15.038303 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:15.038890 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:15.039008 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:15.043155 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:15.043164 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:15.043169 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:15.043222 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:15.047670 (+ 4448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:15.048915 (+ 1245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:15.048925 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:15.048929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:15.049184 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:15.049826 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:15.049831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:15.049833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:15.050146 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:15.050519 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:15.050821 (+ 302us) server_negotiation.cc:299] Negotiation successful
0805 22:59:15.051044 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 22:59:15.057169 18897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:15.067160 18897 catalog_manager.cc:1347] Generated new cluster ID: 46be067c177b49329eb4f1cf8efac590
I20260805 22:59:15.067301 18897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:15.091440 18897 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:15.093672 18897 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:15.107633 18897 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c32840131a141119fe56ad1d93e72bf: Generated new TSK 0
I20260805 22:59:15.108785 18897 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:15.115216 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 18781
I20260805 22:59:15.116883 18871 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:15.218304 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 18781
2026-08-05T22:59:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2429 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:15 dist-test-slave-gmjp krb5kdc[18927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:15 dist-test-slave-gmjp krb5kdc[18927](info): set up 2 sockets
Aug 05 22:59:15 dist-test-slave-gmjp krb5kdc[18927](info): commencing operation
krb5kdc: starting...
W20260805 22:59:16.583257 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:16 dist-test-slave-gmjp krb5kdc[18927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:16.960135 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:17.339802 18945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:17.340286 18945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:17.340466 18945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:17.348197 18945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:17.348377 18945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:17.348483 18945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:17.348599 18945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:17.348685 18945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:17.359301 18945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:17.360891 18945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:17.362308 18945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:17.375257 18953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:17.375532 18952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:17.375370 18955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:17.376520 18945 server_base.cc:1034] running on GCE node
I20260805 22:59:17.377441 18945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:17.378997 18945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:17.380263 18945 hybrid_clock.cc:648] HybridClock initialized: now 1785970757380213 us; error 42 us; skew 500 ppm
I20260805 22:59:17.380650 18945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:17 dist-test-slave-gmjp krb5kdc[18927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970757, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:17.383889 18945 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:17.385556 18945 webserver.cc:460] Webserver started at http://127.0.0.1:42585/ using document root <none> and password file <none>
I20260805 22:59:17.386252 18945 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:17.386363 18945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:17.386628 18945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:17.389906 18945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "cc749a554a064b86815306d722241fa2"
format_stamp: "Formatted at 2026-08-05 22:59:17 on dist-test-slave-gmjp"
server_key: "bdff1deb079149f7d3e17f4014dd41e7"
server_key_iv: "e271e2ea80a1f51f09402fe046f7c4e4"
server_key_version: "encryptionkey@0"
I20260805 22:59:17.390743 18945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "cc749a554a064b86815306d722241fa2"
format_stamp: "Formatted at 2026-08-05 22:59:17 on dist-test-slave-gmjp"
server_key: "bdff1deb079149f7d3e17f4014dd41e7"
server_key_iv: "e271e2ea80a1f51f09402fe046f7c4e4"
server_key_version: "encryptionkey@0"
I20260805 22:59:17.396786 18945 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260805 22:59:17.400668 18962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:17.402179 18945 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 22:59:17.402393 18945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "cc749a554a064b86815306d722241fa2"
format_stamp: "Formatted at 2026-08-05 22:59:17 on dist-test-slave-gmjp"
server_key: "bdff1deb079149f7d3e17f4014dd41e7"
server_key_iv: "e271e2ea80a1f51f09402fe046f7c4e4"
server_key_version: "encryptionkey@0"
I20260805 22:59:17.402639 18945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:17.431412 18945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:17.435981 18945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:17.436314 18945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:17.456769 18945 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43353
I20260805 22:59:17.456789 19040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43353 every 8 connection(s)
I20260805 22:59:17.458647 18945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:17.459206 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 18945
I20260805 22:59:17.459451 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:17.460235 20617 external_mini_cluster.cc:1428] Setting key 97d537c12dbb63ddf9cb556a3ef76bcd
I20260805 22:59:17.463992 19041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:17.476655 19051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:17.462309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48633 (local address 127.0.0.1:43353)
0805 22:59:17.463185 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:17.463200 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:17.463252 (+ 52us) server_negotiation.cc:407] Connection header received
0805 22:59:17.465673 (+ 2421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:17.465708 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:17.466261 (+ 553us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:17.466737 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:17.467334 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:17.469460 (+ 2126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:17.470882 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:17.471977 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:17.472203 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:17.473479 (+ 1276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:17.473491 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:17.473511 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:17.474338 (+ 827us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:17.474439 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:17.474477 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:17.474613 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:17.474824 (+ 211us) server_negotiation.cc:299] Negotiation successful
0805 22:59:17.475146 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":351,"threads_started":1}
I20260805 22:59:17.478612 19041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2: Bootstrap starting.
I20260805 22:59:17.480674 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:17.482206 19041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:17.483253 19041 log.cc:824] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:17.486881 19041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2: No bootstrap required, opened a new log
I20260805 22:59:17.491984 19051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:17.485365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35065 (local address 127.0.0.1:43353)
0805 22:59:17.485543 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:17.485549 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:17.485906 (+ 357us) server_negotiation.cc:407] Connection header received
0805 22:59:17.486080 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:17.486086 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:17.486165 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:17.486289 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:17.486762 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:17.487900 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:17.489281 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:17.490001 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:17.490149 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:17.491187 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:17.491193 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:17.491197 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:17.491223 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:17.491271 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:17.491290 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:17.491378 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:17.491510 (+ 132us) server_negotiation.cc:299] Negotiation successful
0805 22:59:17.491603 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 22:59:17.496285 19041 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc749a554a064b86815306d722241fa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43353 } }
I20260805 22:59:17.496693 19041 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:17.496783 19041 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc749a554a064b86815306d722241fa2, State: Initialized, Role: FOLLOWER
I20260805 22:59:17.497457 19041 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc749a554a064b86815306d722241fa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43353 } }
I20260805 22:59:17.497678 19041 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:17.497787 19041 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:17.497925 19041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:17.500623 19041 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc749a554a064b86815306d722241fa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43353 } }
I20260805 22:59:17.501092 19041 leader_election.cc:302] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc749a554a064b86815306d722241fa2; no voters:
I20260805 22:59:17.501744 19041 leader_election.cc:288] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:17.501942 19061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:17.502647 19061 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [term 1 LEADER]: Becoming Leader. State: Replica: cc749a554a064b86815306d722241fa2, State: Running, Role: LEADER
I20260805 22:59:17.503154 19061 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc749a554a064b86815306d722241fa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43353 } }
I20260805 22:59:17.503942 19041 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:17.506412 19063 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc749a554a064b86815306d722241fa2. Latest consensus state: current_term: 1 leader_uuid: "cc749a554a064b86815306d722241fa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc749a554a064b86815306d722241fa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43353 } } }
I20260805 22:59:17.506955 19063 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:17.507040 19062 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc749a554a064b86815306d722241fa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc749a554a064b86815306d722241fa2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43353 } } }
I20260805 22:59:17.507447 19062 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:17.509003 19067 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:17.514746 19067 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:17.523828 19067 catalog_manager.cc:1347] Generated new cluster ID: 5d3149ae7b534ed980d1f758a5535054
I20260805 22:59:17.523970 19067 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:17.544023 19067 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:17.545467 19067 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:17.553617 19067 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc749a554a064b86815306d722241fa2: Generated new TSK 0
I20260805 22:59:17.554795 19067 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:17.569694 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 18945
W20260805 22:59:17.570982 19035 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48633
W20260805 22:59:17.571710 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 18945: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:17.571889 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 18945
2026-08-05T22:59:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2356 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:17 dist-test-slave-gmjp krb5kdc[19085](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:17 dist-test-slave-gmjp krb5kdc[19085](info): set up 2 sockets
Aug 05 22:59:17 dist-test-slave-gmjp krb5kdc[19085](info): commencing operation
krb5kdc: starting...
W20260805 22:59:18.937594 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.320s user 0.005s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:19 dist-test-slave-gmjp krb5kdc[19085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:19.319677 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42537
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:19.685956 19101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:19.686350 19101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:19.686520 19101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:19.694208 19101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:19.694392 19101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:19.694506 19101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:19.694613 19101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:19.694694 19101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:19.705237 19101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:19.706681 19101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:19.708101 19101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:19.720688 19112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:19.720667 19115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:19.720616 19113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:19.721813 19101 server_base.cc:1034] running on GCE node
I20260805 22:59:19.722793 19101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:19.724470 19101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:19.725710 19101 hybrid_clock.cc:648] HybridClock initialized: now 1785970759725661 us; error 46 us; skew 500 ppm
I20260805 22:59:19.726097 19101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:19 dist-test-slave-gmjp krb5kdc[19085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970759, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:19.729483 19101 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:19.731170 19101 webserver.cc:460] Webserver started at http://127.0.0.1:37029/ using document root <none> and password file <none>
I20260805 22:59:19.731917 19101 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:19.732066 19101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:19.732426 19101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:19.735610 19101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "0e3ac7cbca02401282ae78bfc2e73602"
format_stamp: "Formatted at 2026-08-05 22:59:19 on dist-test-slave-gmjp"
server_key: "0ef00e89f674a97c7109b566952b7970"
server_key_iv: "6ad3291afcee2ea525a94a47219079e4"
server_key_version: "encryptionkey@0"
I20260805 22:59:19.736512 19101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "0e3ac7cbca02401282ae78bfc2e73602"
format_stamp: "Formatted at 2026-08-05 22:59:19 on dist-test-slave-gmjp"
server_key: "0ef00e89f674a97c7109b566952b7970"
server_key_iv: "6ad3291afcee2ea525a94a47219079e4"
server_key_version: "encryptionkey@0"
I20260805 22:59:19.742174 19101 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:59:19.746205 19128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:19.747759 19101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:59:19.747992 19101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "0e3ac7cbca02401282ae78bfc2e73602"
format_stamp: "Formatted at 2026-08-05 22:59:19 on dist-test-slave-gmjp"
server_key: "0ef00e89f674a97c7109b566952b7970"
server_key_iv: "6ad3291afcee2ea525a94a47219079e4"
server_key_version: "encryptionkey@0"
I20260805 22:59:19.748248 19101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:19.754482 19101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:19.759059 19101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:19.759379 19101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:19.778766 19101 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42537
I20260805 22:59:19.778810 19223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42537 every 8 connection(s)
I20260805 22:59:19.780347 19101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:19.784288 19224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:19.787065 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 19101
I20260805 22:59:19.787262 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:19.787803 20617 external_mini_cluster.cc:1428] Setting key 24da24a3dc5e83565b239f4cbf01535a
I20260805 22:59:19.796475 19227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:19.789870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48267 (local address 127.0.0.1:42537)
0805 22:59:19.790813 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:19.790826 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:19.790872 (+ 46us) server_negotiation.cc:407] Connection header received
0805 22:59:19.792736 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:19.792763 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:19.793151 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:19.793497 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:19.794721 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:19.794728 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:19.794743 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:19.794762 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:19.794829 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:19.794859 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:19.795049 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:19.795160 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 22:59:19.795379 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":441,"threads_started":1}
I20260805 22:59:19.797695 19224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602: Bootstrap starting.
I20260805 22:59:19.800340 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:19.801311 19224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:19.802645 19224 log.cc:824] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:19.805747 19224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602: No bootstrap required, opened a new log
I20260805 22:59:19.808777 19227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:19.806055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47849 (local address 127.0.0.1:42537)
0805 22:59:19.806252 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:19.806258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:19.806659 (+ 401us) server_negotiation.cc:407] Connection header received
0805 22:59:19.806848 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:19.806853 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:19.806915 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:19.807035 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:19.808047 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:19.808054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:19.808060 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:19.808086 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:19.808141 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:19.808186 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:19.808316 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:19.808385 (+ 69us) server_negotiation.cc:299] Negotiation successful
0805 22:59:19.808461 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 22:59:19.815069 19224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3ac7cbca02401282ae78bfc2e73602" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42537 } }
I20260805 22:59:19.815480 19224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:19.815559 19224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e3ac7cbca02401282ae78bfc2e73602, State: Initialized, Role: FOLLOWER
I20260805 22:59:19.816097 19224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3ac7cbca02401282ae78bfc2e73602" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42537 } }
I20260805 22:59:19.816390 19224 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:19.816501 19224 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:19.816624 19224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:19.818862 19224 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3ac7cbca02401282ae78bfc2e73602" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42537 } }
I20260805 22:59:19.819438 19224 leader_election.cc:302] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e3ac7cbca02401282ae78bfc2e73602; no voters:
I20260805 22:59:19.820180 19224 leader_election.cc:288] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:19.820329 19236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:19.821081 19236 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [term 1 LEADER]: Becoming Leader. State: Replica: 0e3ac7cbca02401282ae78bfc2e73602, State: Running, Role: LEADER
I20260805 22:59:19.821710 19236 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3ac7cbca02401282ae78bfc2e73602" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42537 } }
I20260805 22:59:19.822530 19224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:19.825225 19239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e3ac7cbca02401282ae78bfc2e73602. Latest consensus state: current_term: 1 leader_uuid: "0e3ac7cbca02401282ae78bfc2e73602" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3ac7cbca02401282ae78bfc2e73602" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42537 } } }
I20260805 22:59:19.825217 19237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e3ac7cbca02401282ae78bfc2e73602" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e3ac7cbca02401282ae78bfc2e73602" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42537 } } }
I20260805 22:59:19.825740 19239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:19.825773 19237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:19.827909 19250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:19.833460 19250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:19.843080 19250 catalog_manager.cc:1347] Generated new cluster ID: eed2471f5f7a40e1b47d134002bffefe
I20260805 22:59:19.843221 19250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:19.856707 19250 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:19.857174 19250 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:19.864041 19250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e3ac7cbca02401282ae78bfc2e73602: Generated new TSK 0
I20260805 22:59:19.864944 19250 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:19.882054 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19101
W20260805 22:59:19.883234 19212 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48267
W20260805 22:59:19.884011 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19101: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:19.884207 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 19101
2026-08-05T22:59:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2309 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:20 dist-test-slave-gmjp krb5kdc[19267](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:20 dist-test-slave-gmjp krb5kdc[19267](info): set up 2 sockets
Aug 05 22:59:20 dist-test-slave-gmjp krb5kdc[19267](info): commencing operation
krb5kdc: starting...
W20260805 22:59:21.305323 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.377s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:21 dist-test-slave-gmjp krb5kdc[19267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:21.687054 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38243
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:22.053222 19283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:22.053643 19283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:22.053835 19283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:22.061481 19283 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:22.061684 19283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:22.061800 19283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:22.061916 19283 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:22.062011 19283 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:22.072567 19283 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:22.074043 19283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:22.075626 19283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:22.088325 19292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:22.088429 19295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:22.088917 19291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:22.089337 19283 server_base.cc:1034] running on GCE node
I20260805 22:59:22.090276 19283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:22.091913 19283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:22.093163 19283 hybrid_clock.cc:648] HybridClock initialized: now 1785970762093101 us; error 78 us; skew 500 ppm
I20260805 22:59:22.093559 19283 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:22 dist-test-slave-gmjp krb5kdc[19267](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970762, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:22.102769 19283 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:22.104655 19283 webserver.cc:460] Webserver started at http://127.0.0.1:35013/ using document root <none> and password file <none>
I20260805 22:59:22.105450 19283 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:22.105624 19283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:22.105981 19283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:22.109524 19283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "be2636a9593a4c01b4b55397ebcb1d4a"
format_stamp: "Formatted at 2026-08-05 22:59:22 on dist-test-slave-gmjp"
server_key: "14f46818f4a9705bd9c7f14c250d1493"
server_key_iv: "4b5b83667487db6e6c08e7105dc83993"
server_key_version: "encryptionkey@0"
I20260805 22:59:22.110472 19283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "be2636a9593a4c01b4b55397ebcb1d4a"
format_stamp: "Formatted at 2026-08-05 22:59:22 on dist-test-slave-gmjp"
server_key: "14f46818f4a9705bd9c7f14c250d1493"
server_key_iv: "4b5b83667487db6e6c08e7105dc83993"
server_key_version: "encryptionkey@0"
I20260805 22:59:22.116400 19283 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:59:22.120244 19307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:22.121639 19283 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:59:22.121841 19283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "be2636a9593a4c01b4b55397ebcb1d4a"
format_stamp: "Formatted at 2026-08-05 22:59:22 on dist-test-slave-gmjp"
server_key: "14f46818f4a9705bd9c7f14c250d1493"
server_key_iv: "4b5b83667487db6e6c08e7105dc83993"
server_key_version: "encryptionkey@0"
I20260805 22:59:22.122078 19283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:22.141866 19283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:22.146440 19283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:22.146768 19283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:22.167500 19283 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38243
I20260805 22:59:22.167562 19385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38243 every 8 connection(s)
I20260805 22:59:22.169106 19283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:22.173107 19386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:22.175688 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 19283
I20260805 22:59:22.175899 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:22.176436 20617 external_mini_cluster.cc:1428] Setting key 3ede4232de835a71f3eddb660f273eb9
I20260805 22:59:22.185216 19386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a: Bootstrap starting.
I20260805 22:59:22.188416 19386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:22.189446 19386 log.cc:824] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a: Log is configured to *not* fsync() on all Append() calls
Aug 05 22:59:22 dist-test-slave-gmjp krb5kdc[19267](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:59:22.192955 19386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a: No bootstrap required, opened a new log
I20260805 22:59:22.200651 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:22.178573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:35289 (local address 127.0.0.1:38243)
0805 22:59:22.179441 (+ 868us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:22.179454 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:22.179498 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:59:22.181268 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:22.181293 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:22.181801 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:22.182222 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:22.183767 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:22.185140 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:22.186505 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:22.187218 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:22.187413 (+ 195us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:22.192389 (+ 4976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:22.192397 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:22.192414 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:22.192452 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:22.195836 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:22.196941 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:22.196948 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:22.196956 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:22.197137 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:22.197659 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:22.197663 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:22.197665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:22.198246 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:22.198609 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:22.199051 (+ 442us) server_negotiation.cc:299] Negotiation successful
0805 22:59:22.199416 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":360,"threads_started":1}
I20260805 22:59:22.202256 19386 raft_consensus.cc:348] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2636a9593a4c01b4b55397ebcb1d4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38243 } }
I20260805 22:59:22.202664 19386 raft_consensus.cc:374] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:22.202793 19386 raft_consensus.cc:729] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be2636a9593a4c01b4b55397ebcb1d4a, State: Initialized, Role: FOLLOWER
I20260805 22:59:22.203461 19386 consensus_queue.cc:260] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2636a9593a4c01b4b55397ebcb1d4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38243 } }
I20260805 22:59:22.203755 19386 raft_consensus.cc:388] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:22.203917 19386 raft_consensus.cc:482] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:22.204180 19386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:22.205003 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:22.207460 19386 raft_consensus.cc:504] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2636a9593a4c01b4b55397ebcb1d4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38243 } }
I20260805 22:59:22.208177 19386 leader_election.cc:302] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be2636a9593a4c01b4b55397ebcb1d4a; no voters:
I20260805 22:59:22.208948 19386 leader_election.cc:288] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:22.209103 19396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:22.211081 19396 raft_consensus.cc:686] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [term 1 LEADER]: Becoming Leader. State: Replica: be2636a9593a4c01b4b55397ebcb1d4a, State: Running, Role: LEADER
I20260805 22:59:22.211791 19386 sys_catalog.cc:564] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:22.211980 19396 consensus_queue.cc:237] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2636a9593a4c01b4b55397ebcb1d4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38243 } }
I20260805 22:59:22.215183 19404 sys_catalog.cc:455] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader be2636a9593a4c01b4b55397ebcb1d4a. Latest consensus state: current_term: 1 leader_uuid: "be2636a9593a4c01b4b55397ebcb1d4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2636a9593a4c01b4b55397ebcb1d4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38243 } } }
I20260805 22:59:22.216037 19404 sys_catalog.cc:458] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:22.215924 19400 sys_catalog.cc:455] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be2636a9593a4c01b4b55397ebcb1d4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be2636a9593a4c01b4b55397ebcb1d4a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38243 } } }
I20260805 22:59:22.216369 19400 sys_catalog.cc:458] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:22.226061 19411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:22.232380 19411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:22.237020 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:22.211708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:44073 (local address 127.0.0.1:38243)
0805 22:59:22.211863 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:22.211869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:22.212526 (+ 657us) server_negotiation.cc:407] Connection header received
0805 22:59:22.212728 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:22.212733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:22.212828 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:22.212949 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:22.215225 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:22.216703 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:22.219224 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:22.220513 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:22.220688 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:22.225525 (+ 4837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:22.225536 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:22.225545 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:22.225616 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:22.230947 (+ 5331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:22.232491 (+ 1544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:22.232500 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:22.232506 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:22.232722 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:22.233503 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:22.233515 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:22.233522 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:22.234090 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:22.234445 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:22.236127 (+ 1682us) server_negotiation.cc:299] Negotiation successful
0805 22:59:22.236441 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260805 22:59:22.251019 19411 catalog_manager.cc:1347] Generated new cluster ID: b33567f9fc5947289a7144f7a5eb4bf6
I20260805 22:59:22.251160 19411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:22.298555 19411 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:22.299949 19411 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:22.313473 19411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be2636a9593a4c01b4b55397ebcb1d4a: Generated new TSK 0
I20260805 22:59:22.314428 19411 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:22.323817 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19283
I20260805 22:59:22.325337 19380 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:22.425032 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 19283
W20260805 22:59:22.452382 19264 connection.cc:535] client connection to 127.0.0.1:38243 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38243): Connection reset by peer (error 104)
2026-08-05T22:59:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2544 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:22 dist-test-slave-gmjp krb5kdc[19433](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:22 dist-test-slave-gmjp krb5kdc[19433](info): set up 2 sockets
Aug 05 22:59:22 dist-test-slave-gmjp krb5kdc[19433](info): commencing operation
krb5kdc: starting...
W20260805 22:59:23.772579 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.002s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:24 dist-test-slave-gmjp krb5kdc[19433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:24.151486 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45459
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:24.524138 19450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:24.524569 19450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:24.524791 19450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:24.532617 19450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:24.532760 19450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:24.532891 19450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:24.532997 19450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:24.533077 19450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:24.544137 19450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:24.545691 19450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:24.547130 19450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:24.559510 19457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:24.559556 19456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:24.559599 19463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:24.560878 19450 server_base.cc:1034] running on GCE node
I20260805 22:59:24.561882 19450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:24.563618 19450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:24.564884 19450 hybrid_clock.cc:648] HybridClock initialized: now 1785970764564844 us; error 54 us; skew 500 ppm
I20260805 22:59:24.565272 19450 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:24 dist-test-slave-gmjp krb5kdc[19433](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970764, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:24.568645 19450 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:24.570371 19450 webserver.cc:460] Webserver started at http://127.0.0.1:34731/ using document root <none> and password file <none>
I20260805 22:59:24.571179 19450 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:24.571337 19450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:24.571673 19450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:24.575201 19450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "a41434364a3d49b1ad5d5540db222e26"
format_stamp: "Formatted at 2026-08-05 22:59:24 on dist-test-slave-gmjp"
server_key: "f4487b3abf6bce14e37c333534dab6e8"
server_key_iv: "316b30139e4255af9b373e38da6be96c"
server_key_version: "encryptionkey@0"
I20260805 22:59:24.576109 19450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "a41434364a3d49b1ad5d5540db222e26"
format_stamp: "Formatted at 2026-08-05 22:59:24 on dist-test-slave-gmjp"
server_key: "f4487b3abf6bce14e37c333534dab6e8"
server_key_iv: "316b30139e4255af9b373e38da6be96c"
server_key_version: "encryptionkey@0"
I20260805 22:59:24.582046 19450 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:59:24.585872 19473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:24.587313 19450 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:59:24.587538 19450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "a41434364a3d49b1ad5d5540db222e26"
format_stamp: "Formatted at 2026-08-05 22:59:24 on dist-test-slave-gmjp"
server_key: "f4487b3abf6bce14e37c333534dab6e8"
server_key_iv: "316b30139e4255af9b373e38da6be96c"
server_key_version: "encryptionkey@0"
I20260805 22:59:24.587767 19450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:24.616833 19450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:24.621171 19450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:24.621505 19450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:24.641887 19450 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45459
I20260805 22:59:24.641917 19563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45459 every 8 connection(s)
I20260805 22:59:24.643471 19450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:24.647430 19566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:24.651242 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 19450
I20260805 22:59:24.651468 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:24.652053 20617 external_mini_cluster.cc:1428] Setting key de6251109541e43ec956191f1ef09cc2
I20260805 22:59:24.660483 19566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26: Bootstrap starting.
I20260805 22:59:24.664057 19566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:24.665418 19566 log.cc:824] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:24.666363 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:24.654189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:41469 (local address 127.0.0.1:45459)
0805 22:59:24.654963 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:24.654977 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:24.655019 (+ 42us) server_negotiation.cc:407] Connection header received
0805 22:59:24.656835 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:24.656860 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:24.657326 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:24.657786 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:24.658423 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:24.659766 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:24.661351 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:24.662083 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:24.662318 (+ 235us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:24.663696 (+ 1378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:24.663704 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:24.663720 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:24.664409 (+ 689us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:24.664494 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:24.664526 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:24.664711 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:24.665029 (+ 318us) server_negotiation.cc:299] Negotiation successful
0805 22:59:24.665219 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":319,"threads_started":1}
I20260805 22:59:24.668722 19566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26: No bootstrap required, opened a new log
I20260805 22:59:24.670599 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:24.677786 19566 raft_consensus.cc:348] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a41434364a3d49b1ad5d5540db222e26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } }
I20260805 22:59:24.678260 19566 raft_consensus.cc:374] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:24.678393 19566 raft_consensus.cc:729] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a41434364a3d49b1ad5d5540db222e26, State: Initialized, Role: FOLLOWER
I20260805 22:59:24.679029 19566 consensus_queue.cc:260] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a41434364a3d49b1ad5d5540db222e26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } }
I20260805 22:59:24.679303 19566 raft_consensus.cc:388] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:24.679457 19566 raft_consensus.cc:482] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:24.679649 19566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:24.682482 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:24.675513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:48169 (local address 127.0.0.1:45459)
0805 22:59:24.675733 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:24.675741 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:24.676214 (+ 473us) server_negotiation.cc:407] Connection header received
0805 22:59:24.676483 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:24.676488 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:24.676566 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:24.676689 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:24.677271 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:24.678031 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:24.679779 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:24.680301 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:24.680488 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:24.681721 (+ 1233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:24.681726 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:24.681729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:24.681749 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:24.681787 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:24.681811 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:24.681936 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:24.682143 (+ 207us) server_negotiation.cc:299] Negotiation successful
0805 22:59:24.682199 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 22:59:24.682410 19566 raft_consensus.cc:504] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a41434364a3d49b1ad5d5540db222e26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } }
I20260805 22:59:24.683063 19566 leader_election.cc:302] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a41434364a3d49b1ad5d5540db222e26; no voters:
I20260805 22:59:24.683751 19566 leader_election.cc:288] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:24.683894 19581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:24.686633 19566 sys_catalog.cc:564] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:24.686703 19581 raft_consensus.cc:686] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [term 1 LEADER]: Becoming Leader. State: Replica: a41434364a3d49b1ad5d5540db222e26, State: Running, Role: LEADER
I20260805 22:59:24.687318 19581 consensus_queue.cc:237] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a41434364a3d49b1ad5d5540db222e26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } }
I20260805 22:59:24.691171 19582 sys_catalog.cc:455] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a41434364a3d49b1ad5d5540db222e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a41434364a3d49b1ad5d5540db222e26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } } }
I20260805 22:59:24.691907 19582 sys_catalog.cc:458] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:24.691111 19584 sys_catalog.cc:455] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a41434364a3d49b1ad5d5540db222e26. Latest consensus state: current_term: 1 leader_uuid: "a41434364a3d49b1ad5d5540db222e26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a41434364a3d49b1ad5d5540db222e26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45459 } } }
I20260805 22:59:24.693536 19584 sys_catalog.cc:458] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:24.695945 19598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:24.703044 19598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:24.712853 19598 catalog_manager.cc:1347] Generated new cluster ID: ba6bf205419649a78cae53abcf45fa23
I20260805 22:59:24.713006 19598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:24.739969 19598 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:24.741470 19598 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:24.752607 19598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a41434364a3d49b1ad5d5540db222e26: Generated new TSK 0
I20260805 22:59:24.753835 19598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:24.766553 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19450
W20260805 22:59:24.767863 19555 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.87:41469
W20260805 22:59:24.768735 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19450: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:24.768916 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 19450
W20260805 22:59:24.793782 19430 connection.cc:535] client connection to 127.0.0.1:45459 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45459): Connection reset by peer (error 104)
2026-08-05T22:59:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2341 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:24 dist-test-slave-gmjp krb5kdc[19611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:24 dist-test-slave-gmjp krb5kdc[19611](info): set up 2 sockets
Aug 05 22:59:24 dist-test-slave-gmjp krb5kdc[19611](info): commencing operation
krb5kdc: starting...
W20260805 22:59:26.110292 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.001s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:26 dist-test-slave-gmjp krb5kdc[19611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:26.493779 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38899
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:26.864604 19637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:26.864957 19637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:26.865130 19637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:26.872674 19637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:26.872799 19637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:26.872900 19637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:26.872995 19637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:26.873068 19637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:26.883613 19637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:26.885177 19637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:26.886642 19637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:26.899410 19643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:26.899335 19644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:26.899662 19646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:26.900511 19637 server_base.cc:1034] running on GCE node
I20260805 22:59:26.901410 19637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:26.902858 19637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:26.904081 19637 hybrid_clock.cc:648] HybridClock initialized: now 1785970766904016 us; error 54 us; skew 500 ppm
I20260805 22:59:26.904515 19637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:26 dist-test-slave-gmjp krb5kdc[19611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970766, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:26.907924 19637 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:26.909693 19637 webserver.cc:460] Webserver started at http://127.0.0.1:35199/ using document root <none> and password file <none>
I20260805 22:59:26.910411 19637 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:26.910529 19637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:26.910812 19637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:26.914269 19637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "efbdcf381e0a4f658f1aaa6dff7c0144"
format_stamp: "Formatted at 2026-08-05 22:59:26 on dist-test-slave-gmjp"
server_key: "a0b6c60dabc87ab0f91031a64d5edffe"
server_key_iv: "bf0384722fa40e792fc142b5ce501845"
server_key_version: "encryptionkey@0"
I20260805 22:59:26.915042 19637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "efbdcf381e0a4f658f1aaa6dff7c0144"
format_stamp: "Formatted at 2026-08-05 22:59:26 on dist-test-slave-gmjp"
server_key: "a0b6c60dabc87ab0f91031a64d5edffe"
server_key_iv: "bf0384722fa40e792fc142b5ce501845"
server_key_version: "encryptionkey@0"
I20260805 22:59:26.920661 19637 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260805 22:59:26.924470 19655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:26.925910 19637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:59:26.926112 19637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "efbdcf381e0a4f658f1aaa6dff7c0144"
format_stamp: "Formatted at 2026-08-05 22:59:26 on dist-test-slave-gmjp"
server_key: "a0b6c60dabc87ab0f91031a64d5edffe"
server_key_iv: "bf0384722fa40e792fc142b5ce501845"
server_key_version: "encryptionkey@0"
I20260805 22:59:26.926343 19637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:26.932637 19637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:26.937355 19637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:26.937672 19637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:26.957610 19637 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38899
I20260805 22:59:26.957649 19739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38899 every 8 connection(s)
I20260805 22:59:26.959208 19637 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:26.962302 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 19637
I20260805 22:59:26.962531 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:26.963045 20617 external_mini_cluster.cc:1428] Setting key 8a9cec2781e2509ad33a1b8c6774f5d4
I20260805 22:59:26.963469 19740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:26.972301 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:26.964954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:57691 (local address 127.0.0.1:38899)
0805 22:59:26.965771 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:26.965782 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:26.965826 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:59:26.968387 (+ 2561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:26.968414 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:26.968797 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:26.969180 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:26.970495 (+ 1315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:26.970502 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:26.970519 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:26.970545 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:26.970617 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:26.970637 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:26.970884 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:26.970997 (+ 113us) server_negotiation.cc:299] Negotiation successful
0805 22:59:26.971243 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":386,"threads_started":1}
I20260805 22:59:26.976478 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:26.978088 19740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144: Bootstrap starting.
I20260805 22:59:26.982014 19740 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:26.983156 19740 log.cc:824] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:26.984594 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:26.981432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:42507 (local address 127.0.0.1:38899)
0805 22:59:26.981666 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:26.981676 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:26.982139 (+ 463us) server_negotiation.cc:407] Connection header received
0805 22:59:26.982412 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:26.982417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:26.982484 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:26.982604 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:26.983716 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:26.983723 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:26.983727 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:26.983756 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:26.983801 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:26.983822 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:26.983978 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:26.984132 (+ 154us) server_negotiation.cc:299] Negotiation successful
0805 22:59:26.984267 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 22:59:26.986548 19740 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144: No bootstrap required, opened a new log
I20260805 22:59:26.995195 19740 raft_consensus.cc:348] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efbdcf381e0a4f658f1aaa6dff7c0144" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38899 } }
I20260805 22:59:26.995661 19740 raft_consensus.cc:374] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:26.995783 19740 raft_consensus.cc:729] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efbdcf381e0a4f658f1aaa6dff7c0144, State: Initialized, Role: FOLLOWER
I20260805 22:59:26.996516 19740 consensus_queue.cc:260] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efbdcf381e0a4f658f1aaa6dff7c0144" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38899 } }
I20260805 22:59:26.996783 19740 raft_consensus.cc:388] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:26.996946 19740 raft_consensus.cc:482] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:26.997130 19740 raft_consensus.cc:3037] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:26.999547 19740 raft_consensus.cc:504] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efbdcf381e0a4f658f1aaa6dff7c0144" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38899 } }
I20260805 22:59:27.000103 19740 leader_election.cc:302] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efbdcf381e0a4f658f1aaa6dff7c0144; no voters:
I20260805 22:59:27.000980 19740 leader_election.cc:288] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:27.001176 19751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:27.002168 19751 raft_consensus.cc:686] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [term 1 LEADER]: Becoming Leader. State: Replica: efbdcf381e0a4f658f1aaa6dff7c0144, State: Running, Role: LEADER
I20260805 22:59:27.002797 19751 consensus_queue.cc:237] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efbdcf381e0a4f658f1aaa6dff7c0144" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38899 } }
I20260805 22:59:27.003389 19740 sys_catalog.cc:564] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:27.006187 19755 sys_catalog.cc:455] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [sys.catalog]: SysCatalogTable state changed. Reason: New leader efbdcf381e0a4f658f1aaa6dff7c0144. Latest consensus state: current_term: 1 leader_uuid: "efbdcf381e0a4f658f1aaa6dff7c0144" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efbdcf381e0a4f658f1aaa6dff7c0144" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38899 } } }
I20260805 22:59:27.006114 19754 sys_catalog.cc:455] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efbdcf381e0a4f658f1aaa6dff7c0144" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efbdcf381e0a4f658f1aaa6dff7c0144" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38899 } } }
I20260805 22:59:27.006584 19754 sys_catalog.cc:458] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:27.006584 19755 sys_catalog.cc:458] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:27.008963 19764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:27.014005 19764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:27.023313 19764 catalog_manager.cc:1347] Generated new cluster ID: 97387931951442f4a84c46ac9ddacb65
I20260805 22:59:27.023473 19764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:27.047817 19764 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:27.048465 19764 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:27.062672 19764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P efbdcf381e0a4f658f1aaa6dff7c0144: Generated new TSK 0
I20260805 22:59:27.063658 19764 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:27.081342 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19637
W20260805 22:59:27.082811 19732 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.87:57691
W20260805 22:59:27.083575 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19637: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:27.083742 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 19637
2026-08-05T22:59:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2322 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:27 dist-test-slave-gmjp krb5kdc[19779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:27 dist-test-slave-gmjp krb5kdc[19779](info): set up 2 sockets
Aug 05 22:59:27 dist-test-slave-gmjp krb5kdc[19779](info): commencing operation
krb5kdc: starting...
W20260805 22:59:28.465474 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.007s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:28 dist-test-slave-gmjp krb5kdc[19779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:28.857542 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38219
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:29.243095 19798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:29.243479 19798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:29.243664 19798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:29.251474 19798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:29.251600 19798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:29.251720 19798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:29.251832 19798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:29.251919 19798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:29.262683 19798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38219
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:29.264143 19798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:29.265589 19798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:29.278154 19805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:29.278216 19809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:29.278184 19807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:29.279412 19798 server_base.cc:1034] running on GCE node
I20260805 22:59:29.280432 19798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:29.282011 19798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:29.283262 19798 hybrid_clock.cc:648] HybridClock initialized: now 1785970769283199 us; error 53 us; skew 500 ppm
I20260805 22:59:29.283633 19798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:29 dist-test-slave-gmjp krb5kdc[19779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970769, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:29.287153 19798 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:29.288821 19798 webserver.cc:460] Webserver started at http://127.0.0.1:33031/ using document root <none> and password file <none>
I20260805 22:59:29.289611 19798 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:29.289781 19798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:29.290115 19798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:29.293560 19798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "b2242ad10a5a419589a86b16307490b5"
format_stamp: "Formatted at 2026-08-05 22:59:29 on dist-test-slave-gmjp"
server_key: "43f4d5c82e1a6158fbebdc14be031b7c"
server_key_iv: "83883fef320f196b1dfa227845401fb4"
server_key_version: "encryptionkey@0"
I20260805 22:59:29.294479 19798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "b2242ad10a5a419589a86b16307490b5"
format_stamp: "Formatted at 2026-08-05 22:59:29 on dist-test-slave-gmjp"
server_key: "43f4d5c82e1a6158fbebdc14be031b7c"
server_key_iv: "83883fef320f196b1dfa227845401fb4"
server_key_version: "encryptionkey@0"
I20260805 22:59:29.300415 19798 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260805 22:59:29.305068 19820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:29.306908 19798 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 22:59:29.307091 19798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "b2242ad10a5a419589a86b16307490b5"
format_stamp: "Formatted at 2026-08-05 22:59:29 on dist-test-slave-gmjp"
server_key: "43f4d5c82e1a6158fbebdc14be031b7c"
server_key_iv: "83883fef320f196b1dfa227845401fb4"
server_key_version: "encryptionkey@0"
I20260805 22:59:29.307291 19798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:29.323263 19798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:29.328007 19798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:29.328363 19798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:29.348773 19798 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38219
I20260805 22:59:29.348809 19903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38219 every 8 connection(s)
I20260805 22:59:29.350437 19798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:29.352108 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 19798
I20260805 22:59:29.352348 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:29.352946 20617 external_mini_cluster.cc:1428] Setting key 69deffe204304b72d1c1f63e94293156
I20260805 22:59:29.355726 19904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 22:59:29 dist-test-slave-gmjp krb5kdc[19779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 22:59:29.367448 19904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5: Bootstrap starting.
I20260805 22:59:29.371812 19904 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:29.373307 19904 log.cc:824] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:29.377288 19904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5: No bootstrap required, opened a new log
I20260805 22:59:29.378509 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:29.354998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:54149 (local address 127.0.0.1:38219)
0805 22:59:29.355806 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:29.355818 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:29.355894 (+ 76us) server_negotiation.cc:407] Connection header received
0805 22:59:29.357692 (+ 1798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:29.357717 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:29.358121 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:29.358586 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:29.360234 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:29.361625 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:29.362954 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:29.363671 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:29.363887 (+ 216us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:29.368616 (+ 4729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:29.368628 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:29.368649 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:29.368705 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:29.372914 (+ 4209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:29.373891 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:29.373905 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:29.373918 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:29.374263 (+ 345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:29.374865 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:29.374869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:29.374896 (+ 27us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:29.375647 (+ 751us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:29.375979 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:29.376629 (+ 650us) server_negotiation.cc:299] Negotiation successful
0805 22:59:29.377005 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":358,"threads_started":1}
I20260805 22:59:29.383047 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:29.386432 19904 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2242ad10a5a419589a86b16307490b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38219 } }
I20260805 22:59:29.386823 19904 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:29.386948 19904 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2242ad10a5a419589a86b16307490b5, State: Initialized, Role: FOLLOWER
I20260805 22:59:29.387705 19904 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2242ad10a5a419589a86b16307490b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38219 } }
I20260805 22:59:29.388048 19904 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:29.388262 19904 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:29.388463 19904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:29.391264 19904 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2242ad10a5a419589a86b16307490b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38219 } }
I20260805 22:59:29.391988 19904 leader_election.cc:302] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2242ad10a5a419589a86b16307490b5; no voters:
I20260805 22:59:29.392694 19904 leader_election.cc:288] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:29.392872 19925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:29.393563 19925 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [term 1 LEADER]: Becoming Leader. State: Replica: b2242ad10a5a419589a86b16307490b5, State: Running, Role: LEADER
I20260805 22:59:29.394284 19925 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2242ad10a5a419589a86b16307490b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38219 } }
I20260805 22:59:29.397519 19927 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2242ad10a5a419589a86b16307490b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2242ad10a5a419589a86b16307490b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38219 } } }
I20260805 22:59:29.397977 19927 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:29.398334 19926 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2242ad10a5a419589a86b16307490b5. Latest consensus state: current_term: 1 leader_uuid: "b2242ad10a5a419589a86b16307490b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2242ad10a5a419589a86b16307490b5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38219 } } }
I20260805 22:59:29.398712 19926 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:29.397989 19904 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:29.403637 19931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:29.410060 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:29.387847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:54795 (local address 127.0.0.1:38219)
0805 22:59:29.388053 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:29.388062 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:29.388628 (+ 566us) server_negotiation.cc:407] Connection header received
0805 22:59:29.388899 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:29.388907 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:29.389001 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:29.389118 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:29.390632 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:29.391816 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:29.393806 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:29.394524 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:29.394630 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:29.398691 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:29.398705 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:29.398714 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:29.398774 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:29.403795 (+ 5021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:29.405135 (+ 1340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:29.405145 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:29.405152 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:29.405420 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:29.406194 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:29.406204 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:29.406208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:29.406749 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:29.407317 (+ 568us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:29.409126 (+ 1809us) server_negotiation.cc:299] Negotiation successful
0805 22:59:29.409417 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 22:59:29.410796 19931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:29.424180 19931 catalog_manager.cc:1347] Generated new cluster ID: 6702dfa550a54d9eaee3b1220b850e3c
I20260805 22:59:29.424376 19931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:29.436791 19931 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:29.438264 19931 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:29.452021 19931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2242ad10a5a419589a86b16307490b5: Generated new TSK 0
I20260805 22:59:29.453033 19931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:29.466821 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19798
I20260805 22:59:29.468655 19892 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:29.564137 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 19798
W20260805 22:59:29.591305 19777 connection.cc:535] client connection to 127.0.0.1:38219 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38219): Connection reset by peer (error 104)
2026-08-05T22:59:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2475 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:29 dist-test-slave-gmjp krb5kdc[19959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:29 dist-test-slave-gmjp krb5kdc[19959](info): set up 2 sockets
Aug 05 22:59:29 dist-test-slave-gmjp krb5kdc[19959](info): commencing operation
krb5kdc: starting...
W20260805 22:59:30.920779 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.002s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:31 dist-test-slave-gmjp krb5kdc[19959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970771, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:31.315148 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42723
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:31.705219 19972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:31.705585 19972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:31.705786 19972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:31.713868 19972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:31.714016 19972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:31.714143 19972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:31.714270 19972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:31.714345 19972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:31.725296 19972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42723
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:31.726891 19972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:31.728461 19972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:31.741904 19977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:31.741966 19978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:31.741966 19981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:31.742918 19972 server_base.cc:1034] running on GCE node
I20260805 22:59:31.743844 19972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:31.745497 19972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:31.746704 19972 hybrid_clock.cc:648] HybridClock initialized: now 1785970771746644 us; error 55 us; skew 500 ppm
I20260805 22:59:31.747087 19972 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:31 dist-test-slave-gmjp krb5kdc[19959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970771, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:31.750502 19972 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:31.752058 19972 webserver.cc:460] Webserver started at http://127.0.0.1:46093/ using document root <none> and password file <none>
I20260805 22:59:31.752815 19972 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:31.752972 19972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:31.753293 19972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:31.756537 19972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7"
format_stamp: "Formatted at 2026-08-05 22:59:31 on dist-test-slave-gmjp"
server_key: "c9d07c90b3bb1e5e4222f87fdbc2b59d"
server_key_iv: "b54365f3206d32d114bc3cea775622a9"
server_key_version: "encryptionkey@0"
I20260805 22:59:31.757452 19972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7"
format_stamp: "Formatted at 2026-08-05 22:59:31 on dist-test-slave-gmjp"
server_key: "c9d07c90b3bb1e5e4222f87fdbc2b59d"
server_key_iv: "b54365f3206d32d114bc3cea775622a9"
server_key_version: "encryptionkey@0"
I20260805 22:59:31.762976 19972 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:59:31.766655 19994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:31.768035 19972 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260805 22:59:31.768258 19972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7"
format_stamp: "Formatted at 2026-08-05 22:59:31 on dist-test-slave-gmjp"
server_key: "c9d07c90b3bb1e5e4222f87fdbc2b59d"
server_key_iv: "b54365f3206d32d114bc3cea775622a9"
server_key_version: "encryptionkey@0"
I20260805 22:59:31.768493 19972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:31.781030 19972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:31.785614 19972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:31.785954 19972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:31.806659 19972 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45981
I20260805 22:59:31.806721 20073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45981 every 8 connection(s)
I20260805 22:59:31.808390 19972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:31.812731 20074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:31.815781 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 19972
I20260805 22:59:31.816018 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:31.816581 20617 external_mini_cluster.cc:1428] Setting key e3fa56ba999134746808d255f1e89fb7
I20260805 22:59:31.825966 20074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7: Bootstrap starting.
I20260805 22:59:31.830049 20074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:31.831259 20074 log.cc:824] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:31.831733 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:31.818832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:42891 (local address 127.0.0.1:45981)
0805 22:59:31.819705 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:31.819719 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:31.819764 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:59:31.821601 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:31.821627 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:31.822110 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:31.822491 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:31.823208 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:31.824708 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:31.826681 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:31.827391 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:31.827551 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:31.829093 (+ 1542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:31.829101 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:31.829117 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:31.829710 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:31.829798 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:31.829825 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:31.829957 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:31.830401 (+ 444us) server_negotiation.cc:299] Negotiation successful
0805 22:59:31.830648 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":394,"threads_started":1}
I20260805 22:59:31.834568 20074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7: No bootstrap required, opened a new log
I20260805 22:59:31.836066 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:31.845623 20074 raft_consensus.cc:348] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45981 } }
I20260805 22:59:31.846072 20074 raft_consensus.cc:374] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:31.846185 20074 raft_consensus.cc:729] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f59ed99bbf7649cd84f117e1e2d6c5a7, State: Initialized, Role: FOLLOWER
I20260805 22:59:31.847024 20074 consensus_queue.cc:260] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45981 } }
I20260805 22:59:31.847344 20074 raft_consensus.cc:388] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:31.847496 20074 raft_consensus.cc:482] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:31.847711 20074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:31.849910 20082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:31.842069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:35791 (local address 127.0.0.1:45981)
0805 22:59:31.842286 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:31.842294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:31.842666 (+ 372us) server_negotiation.cc:407] Connection header received
0805 22:59:31.842841 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:31.842847 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:31.842942 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:31.843083 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:31.843647 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:31.844905 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:31.846434 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:31.847240 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:31.847407 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:31.849014 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:31.849021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:31.849026 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:31.849056 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:31.849127 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:31.849148 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:31.849283 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:31.849493 (+ 210us) server_negotiation.cc:299] Negotiation successful
0805 22:59:31.849554 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 22:59:31.851089 20074 raft_consensus.cc:504] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45981 } }
I20260805 22:59:31.851686 20074 leader_election.cc:302] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f59ed99bbf7649cd84f117e1e2d6c5a7; no voters:
I20260805 22:59:31.852272 20074 leader_election.cc:288] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:31.852425 20093 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:31.853158 20093 raft_consensus.cc:686] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [term 1 LEADER]: Becoming Leader. State: Replica: f59ed99bbf7649cd84f117e1e2d6c5a7, State: Running, Role: LEADER
I20260805 22:59:31.853730 20093 consensus_queue.cc:237] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45981 } }
I20260805 22:59:31.854568 20074 sys_catalog.cc:564] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:31.856738 20096 sys_catalog.cc:455] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f59ed99bbf7649cd84f117e1e2d6c5a7. Latest consensus state: current_term: 1 leader_uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45981 } } }
I20260805 22:59:31.857197 20096 sys_catalog.cc:458] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:31.856511 20095 sys_catalog.cc:455] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59ed99bbf7649cd84f117e1e2d6c5a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45981 } } }
I20260805 22:59:31.858021 20095 sys_catalog.cc:458] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:31.862182 20100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:31.868350 20100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:31.878473 20100 catalog_manager.cc:1347] Generated new cluster ID: a3fbf25490aa44d8a4587258eadae541
I20260805 22:59:31.878616 20100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:31.893805 20100 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:31.895465 20100 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:31.903266 20100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f59ed99bbf7649cd84f117e1e2d6c5a7: Generated new TSK 0
I20260805 22:59:31.904310 20100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:31.909833 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19972
W20260805 22:59:31.911715 20064 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.87:42891
W20260805 22:59:31.912746 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 19972: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:31.912994 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 19972
W20260805 22:59:31.942487 19956 connection.cc:535] client connection to 127.0.0.1:45981 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45981): Connection reset by peer (error 104)
2026-08-05T22:59:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:32 dist-test-slave-gmjp krb5kdc[20132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:32 dist-test-slave-gmjp krb5kdc[20132](info): set up 2 sockets
Aug 05 22:59:32 dist-test-slave-gmjp krb5kdc[20132](info): commencing operation
krb5kdc: starting...
W20260805 22:59:33.270589 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.001s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:33 dist-test-slave-gmjp krb5kdc[20132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 22:59:33.645682 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37947
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37947
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:34.013417 20153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:34.013734 20153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:34.013875 20153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:34.021433 20153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:34.021564 20153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:34.021689 20153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:34.021808 20153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:34.021891 20153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:34.032588 20153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37947
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:34.034204 20153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:34.035657 20153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:34.048715 20167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:34.048734 20163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:34.048771 20162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:34.049600 20153 server_base.cc:1034] running on GCE node
I20260805 22:59:34.050557 20153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:34.052086 20153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:34.053390 20153 hybrid_clock.cc:648] HybridClock initialized: now 1785970774053341 us; error 39 us; skew 500 ppm
I20260805 22:59:34.053802 20153 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:34 dist-test-slave-gmjp krb5kdc[20132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970774, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:34.061244 20153 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 22:59:34.064198 20153 webserver.cc:460] Webserver started at http://127.0.0.1:38547/ using document root <none> and password file <none>
I20260805 22:59:34.065009 20153 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:34.065182 20153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:34.065534 20153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:34.068843 20153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "f7129e9382324c9d8101a73a5a1512db"
format_stamp: "Formatted at 2026-08-05 22:59:34 on dist-test-slave-gmjp"
server_key: "6580d2acaa125be8d9aa14a7e10cbefc"
server_key_iv: "46edafe6ca838fc4c0fd5920f41d8d25"
server_key_version: "encryptionkey@0"
I20260805 22:59:34.069671 20153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "f7129e9382324c9d8101a73a5a1512db"
format_stamp: "Formatted at 2026-08-05 22:59:34 on dist-test-slave-gmjp"
server_key: "6580d2acaa125be8d9aa14a7e10cbefc"
server_key_iv: "46edafe6ca838fc4c0fd5920f41d8d25"
server_key_version: "encryptionkey@0"
I20260805 22:59:34.075490 20153 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:59:34.079578 20177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:34.081112 20153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:59:34.081326 20153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "f7129e9382324c9d8101a73a5a1512db"
format_stamp: "Formatted at 2026-08-05 22:59:34 on dist-test-slave-gmjp"
server_key: "6580d2acaa125be8d9aa14a7e10cbefc"
server_key_iv: "46edafe6ca838fc4c0fd5920f41d8d25"
server_key_version: "encryptionkey@0"
I20260805 22:59:34.081553 20153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:34.088126 20153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:34.093155 20153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:34.093539 20153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:34.114097 20153 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37947
I20260805 22:59:34.114142 20249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37947 every 8 connection(s)
I20260805 22:59:34.115686 20153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:34.119819 20250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:34.125746 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 20153
I20260805 22:59:34.125958 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:34.126541 20617 external_mini_cluster.cc:1428] Setting key 4faaf886803871c2f3803e8dcb2694d6
I20260805 22:59:34.132455 20250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db: Bootstrap starting.
I20260805 22:59:34.135528 20255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:34.128782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:53063 (local address 127.0.0.1:37947)
0805 22:59:34.129829 (+ 1047us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:34.129842 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:34.129894 (+ 52us) server_negotiation.cc:407] Connection header received
0805 22:59:34.131722 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:34.131748 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:34.132206 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:34.132637 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:34.133798 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:34.133804 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:34.133819 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:34.133833 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:34.133897 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:34.133918 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:34.134095 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:34.134236 (+ 141us) server_negotiation.cc:299] Negotiation successful
0805 22:59:34.134511 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":785,"thread_start_us":442,"threads_started":1}
I20260805 22:59:34.136458 20250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:34.137871 20250 log.cc:824] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:34.140024 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:34.141201 20250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db: No bootstrap required, opened a new log
I20260805 22:59:34.147562 20255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:34.144815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.87:46323 (local address 127.0.0.1:37947)
0805 22:59:34.145050 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:34.145058 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:34.145426 (+ 368us) server_negotiation.cc:407] Connection header received
0805 22:59:34.145647 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:34.145652 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:34.145703 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:34.145809 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:34.146844 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:34.146850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:34.146853 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:34.146868 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:34.146914 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:34.146931 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:34.147070 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:34.147203 (+ 133us) server_negotiation.cc:299] Negotiation successful
0805 22:59:34.147275 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 22:59:34.150532 20250 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7129e9382324c9d8101a73a5a1512db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37947 } }
I20260805 22:59:34.151103 20250 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:34.151243 20250 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7129e9382324c9d8101a73a5a1512db, State: Initialized, Role: FOLLOWER
I20260805 22:59:34.151882 20250 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7129e9382324c9d8101a73a5a1512db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37947 } }
I20260805 22:59:34.152158 20250 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:34.152344 20250 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:34.152542 20250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:34.154863 20250 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7129e9382324c9d8101a73a5a1512db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37947 } }
I20260805 22:59:34.155422 20250 leader_election.cc:302] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7129e9382324c9d8101a73a5a1512db; no voters:
I20260805 22:59:34.156083 20250 leader_election.cc:288] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:34.156283 20268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:34.156996 20268 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [term 1 LEADER]: Becoming Leader. State: Replica: f7129e9382324c9d8101a73a5a1512db, State: Running, Role: LEADER
I20260805 22:59:34.157538 20268 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7129e9382324c9d8101a73a5a1512db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37947 } }
I20260805 22:59:34.158514 20250 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:34.161248 20274 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7129e9382324c9d8101a73a5a1512db. Latest consensus state: current_term: 1 leader_uuid: "f7129e9382324c9d8101a73a5a1512db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7129e9382324c9d8101a73a5a1512db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37947 } } }
I20260805 22:59:34.161222 20272 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7129e9382324c9d8101a73a5a1512db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7129e9382324c9d8101a73a5a1512db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37947 } } }
I20260805 22:59:34.161773 20274 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:34.161795 20272 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:34.165237 20281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:34.171260 20281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:34.181767 20281 catalog_manager.cc:1347] Generated new cluster ID: e9264894238848039f2b40c1da6bf941
I20260805 22:59:34.181908 20281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:34.198333 20281 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:34.198899 20281 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:34.209426 20281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7129e9382324c9d8101a73a5a1512db: Generated new TSK 0
I20260805 22:59:34.210351 20281 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:34.220142 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20153
W20260805 22:59:34.221427 20244 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.87:53063
W20260805 22:59:34.222190 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20153: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:34.222352 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 20153
2026-08-05T22:59:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2308 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:34 dist-test-slave-gmjp krb5kdc[20304](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:34 dist-test-slave-gmjp krb5kdc[20304](info): set up 2 sockets
Aug 05 22:59:34 dist-test-slave-gmjp krb5kdc[20304](info): commencing operation
krb5kdc: starting...
W20260805 22:59:35.580791 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.009s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:35 dist-test-slave-gmjp krb5kdc[20304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:59:35.955658 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42145
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:38417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:42145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:36.323551 20324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:36.323876 20324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:36.324062 20324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:36.331722 20324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:36.331861 20324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:36.331969 20324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:36.332063 20324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:36.332188 20324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:36.342643 20324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:42145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:36.344218 20324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:36.345726 20324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:36.358501 20334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:36.358444 20337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:36.358559 20333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:36.361879 20324 server_base.cc:1034] running on GCE node
I20260805 22:59:36.362819 20324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:36.364511 20324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:36.365737 20324 hybrid_clock.cc:648] HybridClock initialized: now 1785970776365689 us; error 36 us; skew 500 ppm
I20260805 22:59:36.366139 20324 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:36 dist-test-slave-gmjp krb5kdc[20304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970776, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:36.369558 20324 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:59:36.371181 20324 webserver.cc:460] Webserver started at http://127.20.34.126:43943/ using document root <none> and password file <none>
I20260805 22:59:36.371987 20324 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:36.372144 20324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:36.372546 20324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:36.375911 20324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "f5abf20ad2744627968178589b70e0a4"
format_stamp: "Formatted at 2026-08-05 22:59:36 on dist-test-slave-gmjp"
server_key: "1e0399519c8707f28f51d33614fec78c"
server_key_iv: "d9c21db90b0cb9b67fb9499ddbbc6b44"
server_key_version: "encryptionkey@0"
I20260805 22:59:36.376950 20324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "f5abf20ad2744627968178589b70e0a4"
format_stamp: "Formatted at 2026-08-05 22:59:36 on dist-test-slave-gmjp"
server_key: "1e0399519c8707f28f51d33614fec78c"
server_key_iv: "d9c21db90b0cb9b67fb9499ddbbc6b44"
server_key_version: "encryptionkey@0"
I20260805 22:59:36.382894 20324 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:59:36.386718 20350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:36.388085 20324 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:59:36.388319 20324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "f5abf20ad2744627968178589b70e0a4"
format_stamp: "Formatted at 2026-08-05 22:59:36 on dist-test-slave-gmjp"
server_key: "1e0399519c8707f28f51d33614fec78c"
server_key_iv: "d9c21db90b0cb9b67fb9499ddbbc6b44"
server_key_version: "encryptionkey@0"
I20260805 22:59:36.388552 20324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:36.413602 20324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:36.418008 20324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:36.418332 20324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:36.438351 20324 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:42145
I20260805 22:59:36.438391 20423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:42145 every 8 connection(s)
I20260805 22:59:36.440096 20324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:36.443974 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 20324
I20260805 22:59:36.444162 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:36.444453 20426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:36.444713 20617 external_mini_cluster.cc:1428] Setting key 3429b37bb6ad2dd8a57bf91c3ed4eda6
I20260805 22:59:36.460024 20426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4: Bootstrap starting.
Aug 05 22:59:36 dist-test-slave-gmjp krb5kdc[20304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:36.463805 20426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:36.465029 20426 log.cc:824] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:36.468216 20426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4: No bootstrap required, opened a new log
I20260805 22:59:36.469484 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:36.446761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41281 (local address 127.20.34.126:42145)
0805 22:59:36.447704 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:36.447717 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:36.447760 (+ 43us) server_negotiation.cc:407] Connection header received
0805 22:59:36.449493 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:36.449516 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:36.449946 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:36.450295 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:36.452278 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:36.453629 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:36.455462 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:36.456205 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:36.456368 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:36.461640 (+ 5272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:36.461651 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:36.461671 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:36.461721 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:36.464972 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:36.465868 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:36.465875 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:36.465885 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:36.466068 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:36.466592 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:36.466596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:36.466598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:36.467116 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:36.467488 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:36.468006 (+ 518us) server_negotiation.cc:299] Negotiation successful
0805 22:59:36.468405 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":449,"threads_started":1}
I20260805 22:59:36.473724 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:36.476853 20426 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abf20ad2744627968178589b70e0a4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42145 } }
I20260805 22:59:36.477384 20426 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:36.477507 20426 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5abf20ad2744627968178589b70e0a4, State: Initialized, Role: FOLLOWER
I20260805 22:59:36.478202 20426 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abf20ad2744627968178589b70e0a4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42145 } }
I20260805 22:59:36.478559 20426 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:36.478719 20426 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:36.478952 20426 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:36.482422 20426 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abf20ad2744627968178589b70e0a4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42145 } }
I20260805 22:59:36.483121 20426 leader_election.cc:302] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5abf20ad2744627968178589b70e0a4; no voters:
I20260805 22:59:36.483873 20426 leader_election.cc:288] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:36.484009 20437 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:36.485690 20437 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [term 1 LEADER]: Becoming Leader. State: Replica: f5abf20ad2744627968178589b70e0a4, State: Running, Role: LEADER
I20260805 22:59:36.486305 20437 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abf20ad2744627968178589b70e0a4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42145 } }
I20260805 22:59:36.486559 20426 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:36.489305 20438 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5abf20ad2744627968178589b70e0a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abf20ad2744627968178589b70e0a4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42145 } } }
I20260805 22:59:36.489730 20438 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:36.490271 20440 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5abf20ad2744627968178589b70e0a4. Latest consensus state: current_term: 1 leader_uuid: "f5abf20ad2744627968178589b70e0a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5abf20ad2744627968178589b70e0a4" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42145 } } }
I20260805 22:59:36.490607 20440 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:36.493059 20450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:36.498669 20450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:36.500551 20430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:36.478576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46591 (local address 127.20.34.126:42145)
0805 22:59:36.478908 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:36.478915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:36.479241 (+ 326us) server_negotiation.cc:407] Connection header received
0805 22:59:36.479536 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:36.479541 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:36.479609 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:36.479707 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:36.481836 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:36.482648 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:36.484666 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:36.485281 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:36.485419 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:36.489550 (+ 4131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:36.489561 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:36.489569 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:36.489631 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:36.495268 (+ 5637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:36.496749 (+ 1481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:36.496759 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:36.496765 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:36.496966 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:36.497795 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:36.497803 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:36.497809 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:36.498404 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:36.498822 (+ 418us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:36.499724 (+ 902us) server_negotiation.cc:299] Negotiation successful
0805 22:59:36.499983 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260805 22:59:36.509558 20450 catalog_manager.cc:1347] Generated new cluster ID: 63c5213d461d4757818a4221f462dd93
I20260805 22:59:36.509682 20450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:36.515589 20467 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:59:36.522017 20450 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:36.524055 20450 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:36.536966 20450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5abf20ad2744627968178589b70e0a4: Generated new TSK 0
I20260805 22:59:36.537938 20450 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:36.546592 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20324
I20260805 22:59:36.548257 20418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:36.645816 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 20324
W20260805 22:59:36.672549 20302 connection.cc:535] client connection to 127.20.34.126:42145 recv error: Network error: failed to read from TLS socket (remote: 127.20.34.126:42145): Connection reset by peer (error 104)
2026-08-05T22:59:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2420 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:36 dist-test-slave-gmjp krb5kdc[20473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:36 dist-test-slave-gmjp krb5kdc[20473](info): set up 2 sockets
Aug 05 22:59:36 dist-test-slave-gmjp krb5kdc[20473](info): commencing operation
krb5kdc: starting...
W20260805 22:59:38.009791 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.318s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:38 dist-test-slave-gmjp krb5kdc[20473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970778, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:59:38.389030 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39573
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:39573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:38.754274 20495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:38.754590 20495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:38.754726 20495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:38.762012 20495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:38.762125 20495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:38.762272 20495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:38.762383 20495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:38.762476 20495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:38.772718 20495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:39573
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:39573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:38.774155 20495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:38.775605 20495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:38.788129 20500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:38.787959 20503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:38.788089 20505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:38.789207 20495 server_base.cc:1034] running on GCE node
I20260805 22:59:38.789958 20495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:38.791337 20495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:38.792541 20495 hybrid_clock.cc:648] HybridClock initialized: now 1785970778792482 us; error 41 us; skew 500 ppm
I20260805 22:59:38.792860 20495 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:38 dist-test-slave-gmjp krb5kdc[20473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970778, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:38.799145 20495 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:59:38.800776 20495 webserver.cc:460] Webserver started at http://127.20.34.126:38449/ using document root <none> and password file <none>
I20260805 22:59:38.801474 20495 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:38.801580 20495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:38.801854 20495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:38.805009 20495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "8442071b8e5741b49fc96bd216ab97d3"
format_stamp: "Formatted at 2026-08-05 22:59:38 on dist-test-slave-gmjp"
server_key: "5a7cc1d9836bc0fd107fc007329899bf"
server_key_iv: "0a48b2ee7faf10bb083b1747d0740485"
server_key_version: "encryptionkey@0"
I20260805 22:59:38.805747 20495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "8442071b8e5741b49fc96bd216ab97d3"
format_stamp: "Formatted at 2026-08-05 22:59:38 on dist-test-slave-gmjp"
server_key: "5a7cc1d9836bc0fd107fc007329899bf"
server_key_iv: "0a48b2ee7faf10bb083b1747d0740485"
server_key_version: "encryptionkey@0"
I20260805 22:59:38.811458 20495 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:59:38.815439 20517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:38.816998 20495 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:59:38.817201 20495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "8442071b8e5741b49fc96bd216ab97d3"
format_stamp: "Formatted at 2026-08-05 22:59:38 on dist-test-slave-gmjp"
server_key: "5a7cc1d9836bc0fd107fc007329899bf"
server_key_iv: "0a48b2ee7faf10bb083b1747d0740485"
server_key_version: "encryptionkey@0"
I20260805 22:59:38.817389 20495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:38.842187 20495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:38.846827 20495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:38.847147 20495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:38.867596 20495 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:39573
I20260805 22:59:38.867596 20595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:39573 every 8 connection(s)
I20260805 22:59:38.869165 20495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:38.873153 20596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:38.877830 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 20495
I20260805 22:59:38.878034 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:38.878636 20617 external_mini_cluster.cc:1428] Setting key 7056ebf3a941ead73a55ea2d18b2b395
I20260805 22:59:38.887074 20596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3: Bootstrap starting.
I20260805 22:59:38.890604 20596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:38.891784 20596 log.cc:824] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:38.892675 20600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:38.880815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41705 (local address 127.20.34.126:39573)
0805 22:59:38.881638 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:38.881651 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:38.881706 (+ 55us) server_negotiation.cc:407] Connection header received
0805 22:59:38.883340 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:38.883367 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:38.883823 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:38.884285 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:38.884976 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:38.886328 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:38.887782 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:38.888553 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:38.888780 (+ 227us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:38.890084 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:38.890091 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:38.890107 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:38.890679 (+ 572us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:38.890786 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:38.890834 (+ 48us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:38.891020 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:38.891281 (+ 261us) server_negotiation.cc:299] Negotiation successful
0805 22:59:38.891463 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":348,"threads_started":1}
I20260805 22:59:38.895032 20596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3: No bootstrap required, opened a new log
I20260805 22:59:38.896893 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:38.905673 20596 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8442071b8e5741b49fc96bd216ab97d3" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39573 } }
I20260805 22:59:38.906272 20596 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:38.906426 20596 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8442071b8e5741b49fc96bd216ab97d3, State: Initialized, Role: FOLLOWER
I20260805 22:59:38.907222 20596 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8442071b8e5741b49fc96bd216ab97d3" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39573 } }
I20260805 22:59:38.907545 20596 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:38.907732 20596 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:38.907934 20596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:38.912325 20596 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8442071b8e5741b49fc96bd216ab97d3" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39573 } }
I20260805 22:59:38.913242 20596 leader_election.cc:302] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8442071b8e5741b49fc96bd216ab97d3; no voters:
I20260805 22:59:38.913380 20600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:38.904578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46905 (local address 127.20.34.126:39573)
0805 22:59:38.904802 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:38.904808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:38.904828 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:59:38.904929 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:38.904938 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:38.905018 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:38.905130 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:38.906188 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:38.907489 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:38.909525 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:38.910269 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:38.910379 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:38.912227 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:38.912234 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:38.912239 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:38.912268 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:38.912372 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:38.912398 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:38.912533 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:38.912882 (+ 349us) server_negotiation.cc:299] Negotiation successful
0805 22:59:38.912956 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 22:59:38.914119 20596 leader_election.cc:288] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:38.914278 20609 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:38.914963 20609 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [term 1 LEADER]: Becoming Leader. State: Replica: 8442071b8e5741b49fc96bd216ab97d3, State: Running, Role: LEADER
I20260805 22:59:38.915750 20609 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8442071b8e5741b49fc96bd216ab97d3" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39573 } }
I20260805 22:59:38.917557 20596 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:38.919602 20610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8442071b8e5741b49fc96bd216ab97d3. Latest consensus state: current_term: 1 leader_uuid: "8442071b8e5741b49fc96bd216ab97d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8442071b8e5741b49fc96bd216ab97d3" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39573 } } }
I20260805 22:59:38.920506 20610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:38.920117 20611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8442071b8e5741b49fc96bd216ab97d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8442071b8e5741b49fc96bd216ab97d3" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 39573 } } }
I20260805 22:59:38.921060 20611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:38.921633 20616 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:38.929335 20616 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:38.943924 20616 catalog_manager.cc:1347] Generated new cluster ID: c537138bbfc745b095490237377b78f0
I20260805 22:59:38.944099 20616 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:38.996848 20616 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:38.998466 20616 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:39.011159 20616 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8442071b8e5741b49fc96bd216ab97d3: Generated new TSK 0
I20260805 22:59:39.012436 20616 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:39.029693 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20495
W20260805 22:59:39.031075 20589 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:41705
W20260805 22:59:39.031924 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20495: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:39.032097 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 20495
W20260805 22:59:39.061946 20470 connection.cc:535] client connection to 127.20.34.126:39573 recv error: Network error: failed to read from TLS socket (remote: 127.20.34.126:39573): Connection reset by peer (error 104)
2026-08-05T22:59:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2389 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:39 dist-test-slave-gmjp krb5kdc[20651](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:39 dist-test-slave-gmjp krb5kdc[20651](info): set up 2 sockets
Aug 05 22:59:39 dist-test-slave-gmjp krb5kdc[20651](info): commencing operation
krb5kdc: starting...
W20260805 22:59:40.383986 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.302s user 0.003s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:40 dist-test-slave-gmjp krb5kdc[20651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970780, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:59:40.771155 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42629
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:36767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:42629
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:41.137259 20667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:41.137590 20667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:41.137732 20667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:41.145463 20667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:41.145627 20667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:41.145752 20667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:41.145874 20667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:41.145968 20667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:41.156682 20667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:36767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:42629
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42629
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:41.158154 20667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:41.159631 20667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:41.172580 20682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:41.172711 20677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:41.172665 20678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:41.174163 20667 server_base.cc:1034] running on GCE node
I20260805 22:59:41.175132 20667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:41.176863 20667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:41.178153 20667 hybrid_clock.cc:648] HybridClock initialized: now 1785970781178101 us; error 60 us; skew 500 ppm
I20260805 22:59:41.178570 20667 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:41 dist-test-slave-gmjp krb5kdc[20651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970781, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:41.182014 20667 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:59:41.186885 20667 webserver.cc:460] Webserver started at http://127.20.34.126:46269/ using document root <none> and password file <none>
I20260805 22:59:41.187947 20667 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:41.188113 20667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:41.188477 20667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:41.191690 20667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "d9fbaedbc9914837b8509b1311ab65fa"
format_stamp: "Formatted at 2026-08-05 22:59:41 on dist-test-slave-gmjp"
server_key: "d9862dd3c493a2829644a3b7b466fb49"
server_key_iv: "55f00c457b56c97a5b5d7801a7a6ec3c"
server_key_version: "encryptionkey@0"
I20260805 22:59:41.192520 20667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "d9fbaedbc9914837b8509b1311ab65fa"
format_stamp: "Formatted at 2026-08-05 22:59:41 on dist-test-slave-gmjp"
server_key: "d9862dd3c493a2829644a3b7b466fb49"
server_key_iv: "55f00c457b56c97a5b5d7801a7a6ec3c"
server_key_version: "encryptionkey@0"
I20260805 22:59:41.198179 20667 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:59:41.202020 20693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:41.203457 20667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:59:41.203667 20667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "d9fbaedbc9914837b8509b1311ab65fa"
format_stamp: "Formatted at 2026-08-05 22:59:41 on dist-test-slave-gmjp"
server_key: "d9862dd3c493a2829644a3b7b466fb49"
server_key_iv: "55f00c457b56c97a5b5d7801a7a6ec3c"
server_key_version: "encryptionkey@0"
I20260805 22:59:41.203898 20667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:41.210120 20667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:41.214601 20667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:41.214957 20667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:41.234977 20667 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:42629
I20260805 22:59:41.235014 20774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:42629 every 8 connection(s)
I20260805 22:59:41.236589 20667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:41.240372 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 20667
I20260805 22:59:41.240571 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:41.240849 20775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:41.241132 20617 external_mini_cluster.cc:1428] Setting key f3ac07f9eeb988a8bc6e899d9e4cd163
I20260805 22:59:41.250664 20779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:41.243108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38745 (local address 127.20.34.126:42629)
0805 22:59:41.244039 (+ 931us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:41.244061 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:41.244117 (+ 56us) server_negotiation.cc:407] Connection header received
0805 22:59:41.246300 (+ 2183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:41.246334 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:41.246884 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:41.247413 (+ 529us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:41.248531 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:41.248540 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:41.248558 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:41.248580 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:41.248666 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:41.248693 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:41.248943 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:41.249096 (+ 153us) server_negotiation.cc:299] Negotiation successful
0805 22:59:41.249341 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":367,"threads_started":1}
I20260805 22:59:41.254896 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:41.256819 20775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa: Bootstrap starting.
I20260805 22:59:41.260521 20775 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:41.261781 20775 log.cc:824] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:41.262565 20779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:41.259730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43703 (local address 127.20.34.126:42629)
0805 22:59:41.259921 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:41.259927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:41.260346 (+ 419us) server_negotiation.cc:407] Connection header received
0805 22:59:41.260531 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:41.260539 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:41.260616 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:41.260758 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:41.261745 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:41.261751 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:41.261756 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:41.261784 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:41.261834 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:41.261855 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:41.261982 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:41.262135 (+ 153us) server_negotiation.cc:299] Negotiation successful
0805 22:59:41.262195 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 22:59:41.265229 20775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa: No bootstrap required, opened a new log
I20260805 22:59:41.272864 20775 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fbaedbc9914837b8509b1311ab65fa" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42629 } }
I20260805 22:59:41.273288 20775 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:41.273411 20775 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9fbaedbc9914837b8509b1311ab65fa, State: Initialized, Role: FOLLOWER
I20260805 22:59:41.274082 20775 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fbaedbc9914837b8509b1311ab65fa" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42629 } }
I20260805 22:59:41.274349 20775 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:41.274513 20775 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:41.274695 20775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:41.277426 20775 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fbaedbc9914837b8509b1311ab65fa" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42629 } }
I20260805 22:59:41.278047 20775 leader_election.cc:302] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9fbaedbc9914837b8509b1311ab65fa; no voters:
I20260805 22:59:41.278715 20775 leader_election.cc:288] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:41.278879 20796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:41.279589 20796 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [term 1 LEADER]: Becoming Leader. State: Replica: d9fbaedbc9914837b8509b1311ab65fa, State: Running, Role: LEADER
I20260805 22:59:41.280273 20796 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fbaedbc9914837b8509b1311ab65fa" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42629 } }
I20260805 22:59:41.281010 20775 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:41.283506 20799 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9fbaedbc9914837b8509b1311ab65fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fbaedbc9914837b8509b1311ab65fa" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42629 } } }
I20260805 22:59:41.283970 20799 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:41.286465 20800 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9fbaedbc9914837b8509b1311ab65fa. Latest consensus state: current_term: 1 leader_uuid: "d9fbaedbc9914837b8509b1311ab65fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fbaedbc9914837b8509b1311ab65fa" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42629 } } }
I20260805 22:59:41.286706 20809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:41.286805 20800 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:41.291927 20809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:41.302767 20809 catalog_manager.cc:1347] Generated new cluster ID: 52fb03bb154a4d8e9d19a079a4a03e71
I20260805 22:59:41.302953 20809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:41.320952 20809 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:41.321425 20809 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:41.334050 20809 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9fbaedbc9914837b8509b1311ab65fa: Generated new TSK 0
I20260805 22:59:41.334939 20809 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:41.346093 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20667
W20260805 22:59:41.347574 20769 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38745
W20260805 22:59:41.348399 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20667: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:41.348570 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 20667
2026-08-05T22:59:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2313 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:41 dist-test-slave-gmjp krb5kdc[20830](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:41 dist-test-slave-gmjp krb5kdc[20830](info): set up 2 sockets
Aug 05 22:59:41 dist-test-slave-gmjp krb5kdc[20830](info): commencing operation
krb5kdc: starting...
W20260805 22:59:42.698258 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.003s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:42 dist-test-slave-gmjp krb5kdc[20830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:59:43.079640 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42031
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:42031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:43.454466 20846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:43.454777 20846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:43.454910 20846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:43.462534 20846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:43.462670 20846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:43.462760 20846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:43.462862 20846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:43.462956 20846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:43.473524 20846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:42031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:43.475003 20846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:43.476493 20846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:43.489240 20855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:43.489334 20852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:43.489333 20857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:43.490505 20846 server_base.cc:1034] running on GCE node
I20260805 22:59:43.491483 20846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:43.493212 20846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:43.494475 20846 hybrid_clock.cc:648] HybridClock initialized: now 1785970783494422 us; error 81 us; skew 500 ppm
I20260805 22:59:43.494894 20846 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:43 dist-test-slave-gmjp krb5kdc[20830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970783, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:43.498411 20846 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:59:43.500036 20846 webserver.cc:460] Webserver started at http://127.20.34.126:36459/ using document root <none> and password file <none>
I20260805 22:59:43.500813 20846 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:43.500973 20846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:43.501304 20846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:43.504506 20846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "62be942fb57741af82da40f5e57de8c9"
format_stamp: "Formatted at 2026-08-05 22:59:43 on dist-test-slave-gmjp"
server_key: "ea5d2e41c6b12707473a0ee1f3d55cac"
server_key_iv: "1e8175e7fb4cda6ffd86efeef5159be8"
server_key_version: "encryptionkey@0"
I20260805 22:59:43.505309 20846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "62be942fb57741af82da40f5e57de8c9"
format_stamp: "Formatted at 2026-08-05 22:59:43 on dist-test-slave-gmjp"
server_key: "ea5d2e41c6b12707473a0ee1f3d55cac"
server_key_iv: "1e8175e7fb4cda6ffd86efeef5159be8"
server_key_version: "encryptionkey@0"
I20260805 22:59:43.510772 20846 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260805 22:59:43.514599 20873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:43.515964 20846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260805 22:59:43.516238 20846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "62be942fb57741af82da40f5e57de8c9"
format_stamp: "Formatted at 2026-08-05 22:59:43 on dist-test-slave-gmjp"
server_key: "ea5d2e41c6b12707473a0ee1f3d55cac"
server_key_iv: "1e8175e7fb4cda6ffd86efeef5159be8"
server_key_version: "encryptionkey@0"
I20260805 22:59:43.516489 20846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:43.532970 20846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:43.537736 20846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:43.538071 20846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:43.557858 20846 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:42031
I20260805 22:59:43.557873 20954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:42031 every 8 connection(s)
I20260805 22:59:43.559329 20846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:43.563311 20955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:43.569752 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 20846
I20260805 22:59:43.569993 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:43.570602 20617 external_mini_cluster.cc:1428] Setting key c077046bec9b0d2d6d1024cbd9ff7686
I20260805 22:59:43.574960 20955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9: Bootstrap starting.
I20260805 22:59:43.578299 20955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:43.579407 20955 log.cc:824] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:43.582289 20955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9: No bootstrap required, opened a new log
Aug 05 22:59:43 dist-test-slave-gmjp krb5kdc[20830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970782, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:43.591877 20955 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62be942fb57741af82da40f5e57de8c9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42031 } }
I20260805 22:59:43.592497 20955 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:43.592630 20955 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62be942fb57741af82da40f5e57de8c9, State: Initialized, Role: FOLLOWER
I20260805 22:59:43.593338 20955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62be942fb57741af82da40f5e57de8c9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42031 } }
I20260805 22:59:43.593611 20955 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:43.593791 20955 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:43.594000 20955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:43.594476 20962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:43.572590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32961 (local address 127.20.34.126:42031)
0805 22:59:43.573410 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:43.573421 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:43.573462 (+ 41us) server_negotiation.cc:407] Connection header received
0805 22:59:43.575194 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:43.575217 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:43.575632 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:43.576027 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:43.577670 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:43.579116 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:43.580600 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:43.581274 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:43.581488 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:43.586127 (+ 4639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:43.586138 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:43.586157 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:43.586198 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:43.589577 (+ 3379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:43.590512 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:43.590520 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:43.590527 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:43.590706 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:43.591142 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:43.591145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:43.591147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:43.591708 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:43.591967 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:43.592554 (+ 587us) server_negotiation.cc:299] Negotiation successful
0805 22:59:43.593128 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":367,"threads_started":1}
I20260805 22:59:43.596834 20955 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62be942fb57741af82da40f5e57de8c9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42031 } }
I20260805 22:59:43.597446 20955 leader_election.cc:302] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62be942fb57741af82da40f5e57de8c9; no voters:
I20260805 22:59:43.598201 20955 leader_election.cc:288] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:43.598335 20965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:43.598577 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:43.601037 20955 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:43.603289 20965 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [term 1 LEADER]: Becoming Leader. State: Replica: 62be942fb57741af82da40f5e57de8c9, State: Running, Role: LEADER
I20260805 22:59:43.604144 20965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62be942fb57741af82da40f5e57de8c9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42031 } }
I20260805 22:59:43.607712 20966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62be942fb57741af82da40f5e57de8c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62be942fb57741af82da40f5e57de8c9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42031 } } }
I20260805 22:59:43.608253 20966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:43.608784 20968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62be942fb57741af82da40f5e57de8c9. Latest consensus state: current_term: 1 leader_uuid: "62be942fb57741af82da40f5e57de8c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62be942fb57741af82da40f5e57de8c9" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42031 } } }
I20260805 22:59:43.609169 20968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:43.617167 20981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:43.624980 20962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:43.603912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47535 (local address 127.20.34.126:42031)
0805 22:59:43.604140 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:43.604188 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:43.604691 (+ 503us) server_negotiation.cc:407] Connection header received
0805 22:59:43.604913 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:43.604922 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:43.604989 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:43.605097 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:43.606984 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:43.608180 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:43.610618 (+ 2438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:43.611602 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:43.611737 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:43.615943 (+ 4206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:43.615954 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:43.615962 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:43.616020 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:43.620965 (+ 4945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:43.622176 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:43.622184 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:43.622190 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:43.622391 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:43.622947 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:43.622955 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:43.622965 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:43.623585 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:43.623873 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:43.624313 (+ 440us) server_negotiation.cc:299] Negotiation successful
0805 22:59:43.624559 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":69}
I20260805 22:59:43.627754 20981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:43.637559 20981 catalog_manager.cc:1347] Generated new cluster ID: d1a964fd23d14fd0a946a730505c9719
I20260805 22:59:43.637701 20981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:43.648773 20981 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:43.650147 20981 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:43.656332 20981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62be942fb57741af82da40f5e57de8c9: Generated new TSK 0
I20260805 22:59:43.657289 20981 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:43.671728 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 20846
I20260805 22:59:43.672935 20943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:43.766976 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 20846
2026-08-05T22:59:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:43 dist-test-slave-gmjp krb5kdc[21007](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:43 dist-test-slave-gmjp krb5kdc[21007](info): set up 2 sockets
Aug 05 22:59:43 dist-test-slave-gmjp krb5kdc[21007](info): commencing operation
krb5kdc: starting...
W20260805 22:59:45.120910 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.000s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:45 dist-test-slave-gmjp krb5kdc[21007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970785, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:59:45.503484 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43155
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:46665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:43155
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:45.869283 21024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:45.869585 21024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:45.869767 21024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:45.877224 21024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:45.877364 21024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:45.877463 21024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:45.877553 21024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:45.877645 21024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:45.887851 21024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:46665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:43155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:43155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:45.889274 21024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:45.890678 21024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:45.903272 21032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:45.903311 21034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:45.903347 21038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:45.904340 21024 server_base.cc:1034] running on GCE node
I20260805 22:59:45.905241 21024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:45.906737 21024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:45.908008 21024 hybrid_clock.cc:648] HybridClock initialized: now 1785970785907949 us; error 46 us; skew 500 ppm
I20260805 22:59:45.908422 21024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:45 dist-test-slave-gmjp krb5kdc[21007](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970785, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:45.915107 21024 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:59:45.916945 21024 webserver.cc:460] Webserver started at http://127.20.34.126:33385/ using document root <none> and password file <none>
I20260805 22:59:45.917793 21024 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:45.917958 21024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:45.918295 21024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:45.921554 21024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "ceca4daa4917434eac8e6a8f916e5b37"
format_stamp: "Formatted at 2026-08-05 22:59:45 on dist-test-slave-gmjp"
server_key: "02682cadf8dd66337ef4294042a68041"
server_key_iv: "a3e3591d7cbc298de6ebfd206c41a78f"
server_key_version: "encryptionkey@0"
I20260805 22:59:45.922387 21024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "ceca4daa4917434eac8e6a8f916e5b37"
format_stamp: "Formatted at 2026-08-05 22:59:45 on dist-test-slave-gmjp"
server_key: "02682cadf8dd66337ef4294042a68041"
server_key_iv: "a3e3591d7cbc298de6ebfd206c41a78f"
server_key_version: "encryptionkey@0"
I20260805 22:59:45.928141 21024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 22:59:45.932271 21048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:45.933790 21024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:59:45.934016 21024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "ceca4daa4917434eac8e6a8f916e5b37"
format_stamp: "Formatted at 2026-08-05 22:59:45 on dist-test-slave-gmjp"
server_key: "02682cadf8dd66337ef4294042a68041"
server_key_iv: "a3e3591d7cbc298de6ebfd206c41a78f"
server_key_version: "encryptionkey@0"
I20260805 22:59:45.934247 21024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:45.952679 21024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:45.957329 21024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:45.957652 21024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:45.978125 21024 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:43155
I20260805 22:59:45.978132 21128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:43155 every 8 connection(s)
I20260805 22:59:45.979692 21024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:45.981540 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21024
I20260805 22:59:45.981748 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:45.982234 20617 external_mini_cluster.cc:1428] Setting key 28420687d2f74c1954de036a688caa6b
I20260805 22:59:45.984319 21129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:45.997035 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:45.984269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49807 (local address 127.20.34.126:43155)
0805 22:59:45.985159 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:45.985170 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:45.985215 (+ 45us) server_negotiation.cc:407] Connection header received
0805 22:59:45.986881 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:45.986904 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:45.987339 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:45.987691 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:45.988470 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:45.990055 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:45.991953 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:45.992711 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:45.992848 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:45.994424 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:45.994434 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:45.994450 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:45.995081 (+ 631us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:45.995172 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:45.995198 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:45.995296 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:45.995558 (+ 262us) server_negotiation.cc:299] Negotiation successful
0805 22:59:45.995900 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":470,"threads_started":1}
I20260805 22:59:45.998306 21129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37: Bootstrap starting.
I20260805 22:59:46.001075 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:46.001819 21129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:46.002844 21129 log.cc:824] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:46.005923 21129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37: No bootstrap required, opened a new log
I20260805 22:59:46.013055 21133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:46.005775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48247 (local address 127.20.34.126:43155)
0805 22:59:46.006013 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:46.006022 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:46.006442 (+ 420us) server_negotiation.cc:407] Connection header received
0805 22:59:46.006664 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:46.006668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:46.006727 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:46.006802 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:46.007476 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:46.008285 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:46.010306 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:46.010787 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:46.010887 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:46.012239 (+ 1352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:46.012245 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:46.012249 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:46.012270 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:46.012315 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:46.012336 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:46.012444 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:46.012597 (+ 153us) server_negotiation.cc:299] Negotiation successful
0805 22:59:46.012688 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 22:59:46.016135 21129 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceca4daa4917434eac8e6a8f916e5b37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43155 } }
I20260805 22:59:46.016610 21129 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:46.016733 21129 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceca4daa4917434eac8e6a8f916e5b37, State: Initialized, Role: FOLLOWER
I20260805 22:59:46.017490 21129 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceca4daa4917434eac8e6a8f916e5b37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43155 } }
I20260805 22:59:46.017745 21129 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:46.017968 21129 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:46.018203 21129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:46.020625 21129 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceca4daa4917434eac8e6a8f916e5b37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43155 } }
I20260805 22:59:46.021191 21129 leader_election.cc:302] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceca4daa4917434eac8e6a8f916e5b37; no voters:
I20260805 22:59:46.021881 21129 leader_election.cc:288] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:46.022042 21141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:46.022768 21141 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [term 1 LEADER]: Becoming Leader. State: Replica: ceca4daa4917434eac8e6a8f916e5b37, State: Running, Role: LEADER
I20260805 22:59:46.023386 21141 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceca4daa4917434eac8e6a8f916e5b37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43155 } }
I20260805 22:59:46.024446 21129 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:46.026562 21142 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceca4daa4917434eac8e6a8f916e5b37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceca4daa4917434eac8e6a8f916e5b37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43155 } } }
I20260805 22:59:46.026965 21142 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:46.027439 21145 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceca4daa4917434eac8e6a8f916e5b37. Latest consensus state: current_term: 1 leader_uuid: "ceca4daa4917434eac8e6a8f916e5b37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceca4daa4917434eac8e6a8f916e5b37" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 43155 } } }
I20260805 22:59:46.027745 21145 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:46.029377 21150 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:46.036401 21150 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:46.048555 21150 catalog_manager.cc:1347] Generated new cluster ID: 8f3c3a70888c41e8bdc3e27cc2259e78
I20260805 22:59:46.048683 21150 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:46.063254 21150 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:46.064738 21150 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:46.078403 21150 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceca4daa4917434eac8e6a8f916e5b37: Generated new TSK 0
I20260805 22:59:46.079329 21150 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:46.092564 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21024
W20260805 22:59:46.094038 21121 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49807
W20260805 22:59:46.094905 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21024: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:46.095079 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21024
2026-08-05T22:59:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2329 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:46 dist-test-slave-gmjp krb5kdc[21173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:46 dist-test-slave-gmjp krb5kdc[21173](info): set up 2 sockets
Aug 05 22:59:46 dist-test-slave-gmjp krb5kdc[21173](info): commencing operation
krb5kdc: starting...
W20260805 22:59:47.447229 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.308s user 0.003s sys 0.057s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:47 dist-test-slave-gmjp krb5kdc[21173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970787, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:59:47.822576 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:37143
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:44183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:37143
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:48.185541 21189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:48.185918 21189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:48.186102 21189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:48.193238 21189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:48.193408 21189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:48.193543 21189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:48.193651 21189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:48.193743 21189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:48.204002 21189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:44183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:37143
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:37143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:48.206019 21189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:48.207937 21189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:48.225399 21201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:48.225682 21200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:48.225726 21204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:48.228029 21189 server_base.cc:1034] running on GCE node
I20260805 22:59:48.229440 21189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:48.231818 21189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:48.233065 21189 hybrid_clock.cc:648] HybridClock initialized: now 1785970788232998 us; error 66 us; skew 500 ppm
I20260805 22:59:48.233470 21189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:48 dist-test-slave-gmjp krb5kdc[21173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970788, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:48.237363 21189 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:59:48.239617 21189 webserver.cc:460] Webserver started at http://127.20.34.126:41057/ using document root <none> and password file <none>
I20260805 22:59:48.240830 21189 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:48.241015 21189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:48.241467 21189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:48.247033 21189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "3909f39d2aaf4b30a9595e7ca83ee042"
format_stamp: "Formatted at 2026-08-05 22:59:48 on dist-test-slave-gmjp"
server_key: "9440ca08e4daaa1ce43e9ab6a4040ac1"
server_key_iv: "d24bb770b8288070e8214fa92b94c595"
server_key_version: "encryptionkey@0"
I20260805 22:59:48.248189 21189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "3909f39d2aaf4b30a9595e7ca83ee042"
format_stamp: "Formatted at 2026-08-05 22:59:48 on dist-test-slave-gmjp"
server_key: "9440ca08e4daaa1ce43e9ab6a4040ac1"
server_key_iv: "d24bb770b8288070e8214fa92b94c595"
server_key_version: "encryptionkey@0"
I20260805 22:59:48.254518 21189 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260805 22:59:48.258224 21217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:48.259603 21189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:59:48.259832 21189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "3909f39d2aaf4b30a9595e7ca83ee042"
format_stamp: "Formatted at 2026-08-05 22:59:48 on dist-test-slave-gmjp"
server_key: "9440ca08e4daaa1ce43e9ab6a4040ac1"
server_key_iv: "d24bb770b8288070e8214fa92b94c595"
server_key_version: "encryptionkey@0"
I20260805 22:59:48.260089 21189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:48.267553 21189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:48.275882 21189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:48.276353 21189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:48.299669 21189 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:37143
I20260805 22:59:48.299826 21287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:37143 every 8 connection(s)
I20260805 22:59:48.301829 21189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:48.306377 21291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:48.311221 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21189
I20260805 22:59:48.311435 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:48.312026 20617 external_mini_cluster.cc:1428] Setting key be6ae022cef08036ce14b09c8e2e20eb
I20260805 22:59:48.318984 21291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042: Bootstrap starting.
I20260805 22:59:48.322582 21296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:48.314173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43127 (local address 127.20.34.126:37143)
0805 22:59:48.315178 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:48.315198 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:48.315256 (+ 58us) server_negotiation.cc:407] Connection header received
0805 22:59:48.318097 (+ 2841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:48.318135 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:48.318686 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:48.319658 (+ 972us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:48.320678 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:48.320683 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:48.320723 (+ 40us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:48.320751 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:48.320816 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:48.320841 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:48.321093 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:48.321233 (+ 140us) server_negotiation.cc:299] Negotiation successful
0805 22:59:48.321452 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":447,"threads_started":1}
I20260805 22:59:48.323294 21291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:48.324762 21291 log.cc:824] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:48.327042 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:48.328284 21291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042: No bootstrap required, opened a new log
I20260805 22:59:48.335819 21296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:48.332686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48367 (local address 127.20.34.126:37143)
0805 22:59:48.332933 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:48.332942 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:48.333318 (+ 376us) server_negotiation.cc:407] Connection header received
0805 22:59:48.333569 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:48.333576 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:48.333639 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:48.333754 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:48.334910 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:48.334917 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:48.334929 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 22:59:48.334960 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:48.335019 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 22:59:48.335050 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:48.335212 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:48.335363 (+ 151us) server_negotiation.cc:299] Negotiation successful
0805 22:59:48.335446 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260805 22:59:48.338372 21291 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3909f39d2aaf4b30a9595e7ca83ee042" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37143 } }
I20260805 22:59:48.338798 21291 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 22:59:48.338932 21291 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3909f39d2aaf4b30a9595e7ca83ee042, State: Initialized, Role: FOLLOWER
I20260805 22:59:48.339701 21291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3909f39d2aaf4b30a9595e7ca83ee042" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37143 } }
I20260805 22:59:48.339975 21291 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 22:59:48.340129 21291 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 22:59:48.340366 21291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:48.342612 21291 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3909f39d2aaf4b30a9595e7ca83ee042" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37143 } }
I20260805 22:59:48.343247 21291 leader_election.cc:302] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3909f39d2aaf4b30a9595e7ca83ee042; no voters:
I20260805 22:59:48.344019 21291 leader_election.cc:288] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 22:59:48.344260 21308 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:48.344965 21308 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [term 1 LEADER]: Becoming Leader. State: Replica: 3909f39d2aaf4b30a9595e7ca83ee042, State: Running, Role: LEADER
I20260805 22:59:48.345590 21308 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3909f39d2aaf4b30a9595e7ca83ee042" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37143 } }
I20260805 22:59:48.346349 21291 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:48.349146 21310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3909f39d2aaf4b30a9595e7ca83ee042. Latest consensus state: current_term: 1 leader_uuid: "3909f39d2aaf4b30a9595e7ca83ee042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3909f39d2aaf4b30a9595e7ca83ee042" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37143 } } }
I20260805 22:59:48.349576 21310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:48.349078 21309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3909f39d2aaf4b30a9595e7ca83ee042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3909f39d2aaf4b30a9595e7ca83ee042" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 37143 } } }
I20260805 22:59:48.350174 21309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:48.352548 21322 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:48.359160 21322 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 22:59:48.371332 21322 catalog_manager.cc:1347] Generated new cluster ID: 07da7377047f493082a2c8660f8f7c05
I20260805 22:59:48.371466 21322 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:48.390292 21322 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:48.390817 21322 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:48.403450 21322 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3909f39d2aaf4b30a9595e7ca83ee042: Generated new TSK 0
I20260805 22:59:48.404683 21322 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 22:59:48.422377 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21189
W20260805 22:59:48.423557 21282 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43127
W20260805 22:59:48.424456 20617 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21189: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 22:59:48.424640 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21189
2026-08-05T22:59:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2335 ms)
[----------] 18 tests from AuthTokenIssuingTest (42775 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:48 dist-test-slave-gmjp krb5kdc[21340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:48 dist-test-slave-gmjp krb5kdc[21340](info): set up 2 sockets
Aug 05 22:59:48 dist-test-slave-gmjp krb5kdc[21340](info): commencing operation
krb5kdc: starting...
W20260805 22:59:49.866210 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.385s user 0.001s sys 0.095s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:50 dist-test-slave-gmjp krb5kdc[21340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:59:50.252472 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34953
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:34953,127.20.34.125:43657,127.20.34.124:40383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:50.620426 21365 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:59:50.620821 21365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:50.620944 21365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:50.621099 21365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:50.628557 21365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:50.628667 21365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:50.628809 21365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:50.628912 21365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:50.629029 21365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:50.639338 21365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:34953,127.20.34.125:43657,127.20.34.124:40383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:34953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:50.640913 21365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:50.642352 21365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:50.654675 21372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:50.654701 21378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:50.654714 21373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:50.655684 21365 server_base.cc:1034] running on GCE node
I20260805 22:59:50.656581 21365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:50.658124 21365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:50.659379 21365 hybrid_clock.cc:648] HybridClock initialized: now 1785970790659301 us; error 55 us; skew 500 ppm
I20260805 22:59:50.659759 21365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:50 dist-test-slave-gmjp krb5kdc[21340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970790, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:50.663147 21365 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:59:50.664817 21365 webserver.cc:460] Webserver started at http://127.20.34.126:37941/ using document root <none> and password file <none>
I20260805 22:59:50.665580 21365 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:50.665726 21365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:50.666100 21365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:50.669410 21365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "6afa26a357234121924acb1c9bab00f6"
format_stamp: "Formatted at 2026-08-05 22:59:50 on dist-test-slave-gmjp"
server_key: "7a12716b78080bb628e529e307d479d1"
server_key_iv: "57acb3a41384816296cda0497b143542"
server_key_version: "encryptionkey@0"
I20260805 22:59:50.670280 21365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "6afa26a357234121924acb1c9bab00f6"
format_stamp: "Formatted at 2026-08-05 22:59:50 on dist-test-slave-gmjp"
server_key: "7a12716b78080bb628e529e307d479d1"
server_key_iv: "57acb3a41384816296cda0497b143542"
server_key_version: "encryptionkey@0"
I20260805 22:59:50.676234 21365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260805 22:59:50.680789 21386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:50.682476 21365 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260805 22:59:50.682693 21365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "6afa26a357234121924acb1c9bab00f6"
format_stamp: "Formatted at 2026-08-05 22:59:50 on dist-test-slave-gmjp"
server_key: "7a12716b78080bb628e529e307d479d1"
server_key_iv: "57acb3a41384816296cda0497b143542"
server_key_version: "encryptionkey@0"
I20260805 22:59:50.682978 21365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:50.726581 21365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:50.731197 21365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:50.731513 21365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:50.751722 21365 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:34953
I20260805 22:59:50.751747 21448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:34953 every 8 connection(s)
I20260805 22:59:50.753257 21365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:50.757258 21450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:50.762024 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21365
I20260805 22:59:50.762298 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:50.763015 20617 external_mini_cluster.cc:1428] Setting key 50385b415222219c02cf03c92dfe53fb
I20260805 22:59:50.764415 21450 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:50 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970790, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:50.787889 21456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:50.767820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35642 (local address 127.20.34.126:34953)
0805 22:59:50.768731 (+ 911us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:50.768751 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:50.769216 (+ 465us) server_negotiation.cc:407] Connection header received
0805 22:59:50.771208 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:50.771214 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:50.771438 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:50.771644 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:50.772963 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:50.774170 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:50.775555 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:50.776100 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:50.776368 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:50.780148 (+ 3780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:50.780216 (+ 68us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:50.780236 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:50.780284 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:50.783126 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:50.784056 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:50.784062 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:50.784064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:50.784288 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:50.784778 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:50.784782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:50.784784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:50.785317 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:50.785476 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:50.786222 (+ 746us) server_negotiation.cc:299] Negotiation successful
0805 22:59:50.786603 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":422,"threads_started":1}
I20260805 22:59:50.787968 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:50.767836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34953 (local address 127.0.0.1:35642)
0805 22:59:50.769044 (+ 1208us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:50.769085 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:50.770829 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:50.771668 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:50.771675 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:50.772418 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:50.772742 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:50.772759 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:50.774350 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:50.774354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:50.775408 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:50.775420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:50.776404 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:50.776411 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:50.776584 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:50.777310 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:50.777335 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:50.779879 (+ 2544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:50.783281 (+ 3402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:50.783298 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:50.783314 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:50.783924 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:50.784413 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:50.784421 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:50.784428 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:50.784666 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:50.785491 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:50.785502 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:50.785756 (+ 254us) client_negotiation.cc:769] Sending connection context
0805 22:59:50.786131 (+ 375us) client_negotiation.cc:240] Negotiation successful
0805 22:59:50.786811 (+ 680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1004,"mutex_wait_us":117,"thread_start_us":758,"threads_started":1}
I20260805 22:59:50.790901 21450 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:59:50.792092 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:50.791574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33844)
0805 22:59:50.791784 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:50.791933 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260805 22:59:50.792398 21389 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
I20260805 22:59:50.794297 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:50.793769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33846)
0805 22:59:50.793983 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:50.794098 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260805 22:59:50.794529 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:43657: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.34.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.125@KRBTEST.COM" created.
I20260805 22:59:50.843959 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } attempt: 1
I20260805 22:59:50.845459 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:50.844865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33848)
0805 22:59:50.845097 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:50.845218 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab.
Entry for principal kudu/127.20.34.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab.
I20260805 22:59:50.846577 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:50.846109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33856)
0805 22:59:50.846285 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:50.846384 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 22:59:50.846768 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:43657: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
I20260805 22:59:50.847496 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.125:43657
--webserver_interface=127.20.34.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab
--principal=kudu/127.20.34.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:34953,127.20.34.125:43657,127.20.34.124:40383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:59:50.915103 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } attempt: 2
I20260805 22:59:50.916703 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:50.916021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33858)
0805 22:59:50.916366 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:50.916499 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260805 22:59:50.918042 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:50.917516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33870)
0805 22:59:50.917742 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:50.917854 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260805 22:59:50.918308 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:43657: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
I20260805 22:59:51.009725 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } attempt: 3
I20260805 22:59:51.011135 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.010467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33882)
0805 22:59:51.010749 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.010903 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260805 22:59:51.012678 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.012129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33888)
0805 22:59:51.012355 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.012467 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260805 22:59:51.012933 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:43657: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
I20260805 22:59:51.156265 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } attempt: 4
I20260805 22:59:51.157753 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.157067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33904)
0805 22:59:51.157429 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.157553 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260805 22:59:51.159010 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.158522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33914)
0805 22:59:51.158707 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.158829 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260805 22:59:51.159250 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:43657: Network error: Client connection negotiation failed: client connection to 127.20.34.125:43657: connect: Connection refused (error 111)
W20260805 22:59:51.231371 21463 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:59:51.231788 21463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:51.231926 21463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:51.232077 21463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:51.239825 21463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:51.239928 21463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:51.239986 21463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:51.240067 21463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:51.240201 21463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:51.250805 21463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:34953,127.20.34.125:43657,127.20.34.124:40383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab
--principal=kudu/127.20.34.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.125:43657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.34.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:51.252259 21463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:51.253736 21463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:51.266409 21471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:51.266507 21470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:51.266439 21474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:51.267256 21463 server_base.cc:1034] running on GCE node
I20260805 22:59:51.268240 21463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:51.269757 21463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:51.271028 21463 hybrid_clock.cc:648] HybridClock initialized: now 1785970791270951 us; error 51 us; skew 500 ppm
I20260805 22:59:51.271401 21463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:51.279457 21463 init.cc:377] Logged in from keytab as kudu/127.20.34.125@KRBTEST.COM (short username kudu)
I20260805 22:59:51.281260 21463 webserver.cc:460] Webserver started at http://127.20.34.125:42897/ using document root <none> and password file <none>
I20260805 22:59:51.282032 21463 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:51.282174 21463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:51.282534 21463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:51.285853 21463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/data/instance:
uuid: "81ef4c659d524c3898d13b449678613d"
format_stamp: "Formatted at 2026-08-05 22:59:51 on dist-test-slave-gmjp"
server_key: "fcce9e13754e8b4633e295fd8d422311"
server_key_iv: "e59e9e0ae54455228ae2d62ef7cbc8b6"
server_key_version: "encryptionkey@0"
I20260805 22:59:51.286734 21463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/wal/instance:
uuid: "81ef4c659d524c3898d13b449678613d"
format_stamp: "Formatted at 2026-08-05 22:59:51 on dist-test-slave-gmjp"
server_key: "fcce9e13754e8b4633e295fd8d422311"
server_key_iv: "e59e9e0ae54455228ae2d62ef7cbc8b6"
server_key_version: "encryptionkey@0"
I20260805 22:59:51.292352 21463 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260805 22:59:51.296502 21486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:51.298015 21463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 22:59:51.298226 21463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/wal
uuid: "81ef4c659d524c3898d13b449678613d"
format_stamp: "Formatted at 2026-08-05 22:59:51 on dist-test-slave-gmjp"
server_key: "fcce9e13754e8b4633e295fd8d422311"
server_key_iv: "e59e9e0ae54455228ae2d62ef7cbc8b6"
server_key_version: "encryptionkey@0"
I20260805 22:59:51.298494 21463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:51.324621 21463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:51.329545 21463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:51.329856 21463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:51.349884 21463 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.125:43657
I20260805 22:59:51.349862 21563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.125:43657 every 8 connection(s)
I20260805 22:59:51.351352 21463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
I20260805 22:59:51.355206 21564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:51.356767 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21463
I20260805 22:59:51.356990 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-1/wal/instance
I20260805 22:59:51.357583 20617 external_mini_cluster.cc:1428] Setting key d6e4b4395f64a16c19c8bfd7a768093b
I20260805 22:59:51.365696 21564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:51.391191 21566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.369435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35648 (local address 127.20.34.126:34953)
0805 22:59:51.370001 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.370010 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.371116 (+ 1106us) server_negotiation.cc:407] Connection header received
0805 22:59:51.373121 (+ 2005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.373129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.373227 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.373372 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.375121 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.375850 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.378541 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.379097 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.379209 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.384135 (+ 4926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:51.384141 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:51.384144 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:51.384252 (+ 108us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:51.387333 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.388488 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.388493 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.388495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.388625 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.389196 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.389203 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.389207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.389614 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:51.389735 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:51.390725 (+ 990us) server_negotiation.cc:299] Negotiation successful
0805 22:59:51.390906 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":271,"threads_started":1}
I20260805 22:59:51.392937 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.370073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34953 (local address 127.0.0.1:35648)
0805 22:59:51.370913 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.370969 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:51.372837 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:51.373579 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:51.373587 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:51.374134 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:51.374869 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.374907 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.376025 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.376034 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.378279 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.378299 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.379366 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.379376 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.379726 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.380575 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:51.380668 (+ 93us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:51.383840 (+ 3172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:51.387548 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.387562 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.387589 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.388341 (+ 752us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.388743 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.388750 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.388756 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.389044 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.389759 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:51.389771 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:51.390296 (+ 525us) client_negotiation.cc:769] Sending connection context
0805 22:59:51.390624 (+ 328us) client_negotiation.cc:240] Negotiation successful
0805 22:59:51.391301 (+ 677us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":358,"threads_started":1}
I20260805 22:59:51.395018 21564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.34.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.124@KRBTEST.COM" created.
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:59:51.411999 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.395906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33916)
0805 22:59:51.396193 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.396215 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:51.396346 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:51.397195 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:51.397202 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:51.397705 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:51.397971 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.397988 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.399474 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.399478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.400670 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.400695 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.401988 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.401992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.402160 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.402816 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:51.402833 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:51.405130 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:51.409514 (+ 4384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.409518 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.409521 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.409877 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.410330 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.410334 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.410337 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.410480 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.411277 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:51.411280 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:51.411393 (+ 113us) client_negotiation.cc:769] Sending connection context
0805 22:59:51.411496 (+ 103us) client_negotiation.cc:240] Negotiation successful
0805 22:59:51.411712 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260805 22:59:51.412618 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.396010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33916 (local address 127.20.34.125:43657)
0805 22:59:51.396715 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.396721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.396749 (+ 28us) server_negotiation.cc:407] Connection header received
0805 22:59:51.396798 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.396803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.397000 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.397122 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.398155 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.399346 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.400851 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.401805 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.401997 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.405351 (+ 3354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:51.405368 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:51.405389 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:51.405440 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:51.409368 (+ 3928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.410040 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.410052 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.410058 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.410219 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.410596 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.410603 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.410608 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.411147 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:51.411392 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:51.411729 (+ 337us) server_negotiation.cc:299] Negotiation successful
0805 22:59:51.412052 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":396,"threads_started":1}
I20260805 22:59:51.415141 21564 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:59:51.416718 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.415968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42262)
0805 22:59:51.416291 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.416496 (+ 205us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260805 22:59:51.417119 21488 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.418951 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.418463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42268)
0805 22:59:51.418670 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.418787 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260805 22:59:51.419201 21564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab.
Entry for principal kudu/127.20.34.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab.
I20260805 22:59:51.444350 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.124:40383
--webserver_interface=127.20.34.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab
--principal=kudu/127.20.34.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:34953,127.20.34.125:43657,127.20.34.124:40383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:59:51.458611 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } attempt: 5
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970790, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:59:51.468538 21564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 1
I20260805 22:59:51.469691 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.469205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42276)
0805 22:59:51.469418 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.469533 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260805 22:59:51.470777 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.470403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42286)
0805 22:59:51.470576 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.470662 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260805 22:59:51.471078 21564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.473897 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.459454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33924)
0805 22:59:51.459822 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.459844 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:51.460030 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:51.460477 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:51.460482 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:51.460899 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:51.461107 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.461116 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.462149 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.462155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.463018 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.463029 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.463827 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.463834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.464129 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.464943 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:51.464966 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:51.467285 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:51.471495 (+ 4210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.471498 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.471502 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.471889 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.472341 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.472344 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.472346 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.472493 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.473157 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:51.473160 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:51.473294 (+ 134us) client_negotiation.cc:769] Sending connection context
0805 22:59:51.473410 (+ 116us) client_negotiation.cc:240] Negotiation successful
0805 22:59:51.473670 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251}
I20260805 22:59:51.474231 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.459615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33924 (local address 127.20.34.125:43657)
0805 22:59:51.459802 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.459809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.459950 (+ 141us) server_negotiation.cc:407] Connection header received
0805 22:59:51.460188 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.460194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.460292 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.460415 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.461273 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.461999 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.463179 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.463647 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.463796 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.467502 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:51.467507 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:51.467511 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:51.467546 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:51.471337 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.472021 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.472029 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.472035 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.472218 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.472602 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.472610 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.472616 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.473027 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:51.473173 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:51.473579 (+ 406us) server_negotiation.cc:299] Negotiation successful
0805 22:59:51.473847 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260805 22:59:51.475117 21450 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:59:51.476428 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.475987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42298)
0805 22:59:51.476197 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.476285 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260805 22:59:51.477473 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.477122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42304)
0805 22:59:51.477273 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.477349 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260805 22:59:51.477705 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.528929 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 1
I20260805 22:59:51.530251 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.529659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42312)
0805 22:59:51.529909 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.530028 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260805 22:59:51.531411 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.530969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42320)
0805 22:59:51.531136 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.531234 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260805 22:59:51.531672 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.539321 21564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 2
I20260805 22:59:51.540441 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.539958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42322)
0805 22:59:51.540147 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.540281 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260805 22:59:51.541393 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.541064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42338)
0805 22:59:51.541209 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.541284 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260805 22:59:51.541606 21564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.599900 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 2
I20260805 22:59:51.601241 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.600646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42346)
0805 22:59:51.600913 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.601029 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260805 22:59:51.602312 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.601932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42360)
0805 22:59:51.602094 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.602185 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 22:59:51.602610 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.633490 21564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 3
I20260805 22:59:51.635057 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.634368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42366)
0805 22:59:51.634686 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.634804 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260805 22:59:51.636425 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.635801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42374)
0805 22:59:51.636110 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.636253 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
W20260805 22:59:51.636773 21564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.708899 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 3
I20260805 22:59:51.710246 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.709738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42388)
0805 22:59:51.709976 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.710072 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260805 22:59:51.711614 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.711101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42390)
0805 22:59:51.711343 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.711455 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260805 22:59:51.711906 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.780050 21564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 4
I20260805 22:59:51.781533 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.780965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42400)
0805 22:59:51.781251 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.781349 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260805 22:59:51.782635 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.782268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42406)
0805 22:59:51.782432 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.782522 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260805 22:59:51.782872 21564 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
W20260805 22:59:51.825650 21573 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:59:51.826077 21573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:51.826211 21573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:51.826351 21573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:51.834095 21573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:51.834237 21573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:51.834364 21573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:51.834456 21573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:51.834574 21573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:51.845476 21573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:34953,127.20.34.125:43657,127.20.34.124:40383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab
--principal=kudu/127.20.34.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.124:40383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.34.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:51.846966 21573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:51.848400 21573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:51.861248 21584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:51.861459 21578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:51.861384 21579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:51.862612 21573 server_base.cc:1034] running on GCE node
I20260805 22:59:51.863528 21573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:51.865245 21573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:51.866514 21573 hybrid_clock.cc:648] HybridClock initialized: now 1785970791866458 us; error 47 us; skew 500 ppm
I20260805 22:59:51.866883 21573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:51.870186 21573 init.cc:377] Logged in from keytab as kudu/127.20.34.124@KRBTEST.COM (short username kudu)
I20260805 22:59:51.871711 21573 webserver.cc:460] Webserver started at http://127.20.34.124:37879/ using document root <none> and password file <none>
I20260805 22:59:51.872532 21573 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:51.872670 21573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:51.873003 21573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:51.876330 21573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/data/instance:
uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70"
format_stamp: "Formatted at 2026-08-05 22:59:51 on dist-test-slave-gmjp"
server_key: "57e13920bf7ff731335bf9b5584303db"
server_key_iv: "f129730b4f3e205b466cdb97b878b6fd"
server_key_version: "encryptionkey@0"
I20260805 22:59:51.877211 21573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/wal/instance:
uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70"
format_stamp: "Formatted at 2026-08-05 22:59:51 on dist-test-slave-gmjp"
server_key: "57e13920bf7ff731335bf9b5584303db"
server_key_iv: "f129730b4f3e205b466cdb97b878b6fd"
server_key_version: "encryptionkey@0"
I20260805 22:59:51.882997 21573 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260805 22:59:51.886966 21594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:51.888573 21573 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 22:59:51.888765 21573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/wal
uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70"
format_stamp: "Formatted at 2026-08-05 22:59:51 on dist-test-slave-gmjp"
server_key: "57e13920bf7ff731335bf9b5584303db"
server_key_iv: "f129730b4f3e205b466cdb97b878b6fd"
server_key_version: "encryptionkey@0"
I20260805 22:59:51.889003 21573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:51.889147 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 4
I20260805 22:59:51.890318 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.889774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42416)
0805 22:59:51.889995 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.890112 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260805 22:59:51.891429 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.891060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42432)
0805 22:59:51.891203 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.891288 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260805 22:59:51.891688 21450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:40383: Network error: Client connection negotiation failed: client connection to 127.20.34.124:40383: connect: Connection refused (error 111)
I20260805 22:59:51.911518 21573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:51.916250 21573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:51.916563 21573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:51.937425 21573 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.124:40383
I20260805 22:59:51.937471 21671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.124:40383 every 8 connection(s)
I20260805 22:59:51.938855 21573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
I20260805 22:59:51.942839 21672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:51.946596 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21573
I20260805 22:59:51.946805 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970399628623-20617-0/minicluster-data/master-2/wal/instance
I20260805 22:59:51.947374 20617 external_mini_cluster.cc:1428] Setting key 7dcb130a9555dd1b1971d39f726929f1
I20260805 22:59:51.951535 21672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:51.972033 21679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.955425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35650 (local address 127.20.34.126:34953)
0805 22:59:51.956841 (+ 1416us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.956848 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.956867 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:59:51.956925 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.956930 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.957014 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.957127 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.958784 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.959748 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.961681 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.962117 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.962224 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.966143 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:51.966149 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:51.966152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:51.966184 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:51.968823 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.969565 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.969570 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.969572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.969784 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.970237 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.970241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.970243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.970514 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:51.970629 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:51.971339 (+ 710us) server_negotiation.cc:299] Negotiation successful
0805 22:59:51.971570 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1289,"thread_start_us":1154,"threads_started":1}
I20260805 22:59:51.973266 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.949698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42444 (local address 127.20.34.124:40383)
0805 22:59:51.950581 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.950594 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.950638 (+ 44us) server_negotiation.cc:407] Connection header received
0805 22:59:51.952389 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.952415 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.952859 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.953281 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.955224 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.957382 (+ 2158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.959277 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.960330 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.960472 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.965480 (+ 5008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:51.965493 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:51.965511 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:51.965550 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:51.968799 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.969498 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.969508 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.969514 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.969680 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.970170 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.970178 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.970181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.970781 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:51.971102 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:51.971379 (+ 277us) server_negotiation.cc:299] Negotiation successful
0805 22:59:51.971860 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":178,"server-negotiator.queue_time_us":652,"thread_start_us":430,"threads_started":1}
I20260805 22:59:51.973240 21678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.955358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:34953 (local address 127.0.0.1:35650)
0805 22:59:51.956345 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.956423 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:51.956620 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:51.957191 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:51.957195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:51.958077 (+ 882us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:51.958594 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.958612 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.959944 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.959949 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.961505 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.961521 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.962385 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.962395 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.962618 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.963295 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:51.963327 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:51.965933 (+ 2606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:51.968977 (+ 3044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.968986 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.968997 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.969393 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.969917 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.969920 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.969922 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.970091 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.970655 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:51.970663 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:51.970900 (+ 237us) client_negotiation.cc:769] Sending connection context
0805 22:59:51.971187 (+ 287us) client_negotiation.cc:240] Negotiation successful
0805 22:59:51.971723 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":366,"threads_started":1}
I20260805 22:59:51.975273 21672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:51.992709 21678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.976117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:43657 (local address 127.0.0.1:33940)
0805 22:59:51.976363 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.976385 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:51.976487 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:51.977435 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:51.977440 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:51.977991 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:51.978225 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.978239 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.979755 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.979759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.981144 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.981160 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.982154 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.982158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.982313 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.983007 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:51.983034 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:51.985782 (+ 2748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:51.989683 (+ 3901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.989689 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.989693 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.990229 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.990609 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:51.990616 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:51.990622 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:51.990833 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:51.991606 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:51.991611 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:51.991815 (+ 204us) client_negotiation.cc:769] Sending connection context
0805 22:59:51.991969 (+ 154us) client_negotiation.cc:240] Negotiation successful
0805 22:59:51.992329 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260805 22:59:51.992762 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.976183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33940 (local address 127.20.34.125:43657)
0805 22:59:51.977108 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.977113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.977132 (+ 19us) server_negotiation.cc:407] Connection header received
0805 22:59:51.977188 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.977202 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.977274 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.977389 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.978475 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.979604 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.981324 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.981989 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.982157 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.986027 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:51.986033 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:51.986036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:51.986073 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:51.989535 (+ 3462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.990360 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.990364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.990366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.990494 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.990987 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.990994 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.990997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.991378 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:51.991575 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:51.992121 (+ 546us) server_negotiation.cc:299] Negotiation successful
0805 22:59:51.992399 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":807,"thread_start_us":677,"threads_started":1}
I20260805 22:59:51.994238 21679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.976899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35666 (local address 127.20.34.126:34953)
0805 22:59:51.977085 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.977091 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.977109 (+ 18us) server_negotiation.cc:407] Connection header received
0805 22:59:51.977165 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.977170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.977243 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.977354 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.978945 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.980009 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.981705 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.982390 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.982495 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:51.987520 (+ 5025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:51.987525 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:51.987528 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:51.987564 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:51.990711 (+ 3147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.991626 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.991631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.991635 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.991829 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:51.992351 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:51.992356 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:51.992359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:51.992732 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:51.993059 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:51.993588 (+ 529us) server_negotiation.cc:299] Negotiation successful
0805 22:59:51.993865 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 22:59:51.994272 21672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:51 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
Aug 05 22:59:52 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:59:52.009737 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.995270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42458 (local address 127.20.34.124:40383)
0805 22:59:51.995466 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.995472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.995658 (+ 186us) server_negotiation.cc:407] Connection header received
0805 22:59:51.995792 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.995797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.995874 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.995980 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.997052 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.997785 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.999111 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.999611 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.999711 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.003631 (+ 3920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:52.003663 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:52.003668 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:52.003705 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:52.006927 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.007695 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.007700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.007702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.007841 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.008342 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.008346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.008348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.008644 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:52.008768 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:52.009272 (+ 504us) server_negotiation.cc:299] Negotiation successful
0805 22:59:52.009480 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":70}
I20260805 22:59:52.010098 21678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.995282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42458)
0805 22:59:51.995551 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:51.995570 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:51.995678 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:51.996027 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:51.996034 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:51.996580 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:51.996885 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.996897 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.997923 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.997929 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:51.998967 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:51.998980 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.999818 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:51.999825 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:52.000053 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.000705 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:52.000729 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:52.003426 (+ 2697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:52.007054 (+ 3628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:52.007060 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:52.007064 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:52.007573 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:52.007999 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:52.008002 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:52.008005 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:52.008221 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:52.008769 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:52.008776 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:52.008961 (+ 185us) client_negotiation.cc:769] Sending connection context
0805 22:59:52.009151 (+ 190us) client_negotiation.cc:240] Negotiation successful
0805 22:59:52.009674 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":135}
I20260805 22:59:52.013715 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:51.996314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33948 (local address 127.20.34.125:43657)
0805 22:59:51.996498 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:51.996504 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:51.996668 (+ 164us) server_negotiation.cc:407] Connection header received
0805 22:59:51.996809 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:51.996812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:51.996871 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:51.996948 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:51.998334 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:51.999078 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.000646 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.001056 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.001153 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.007234 (+ 6081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:52.007241 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:52.007246 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:52.007288 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:52.010676 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.011491 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.011498 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.011502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.011650 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.012104 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.012107 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.012110 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.012446 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:52.012663 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:52.013140 (+ 477us) server_negotiation.cc:299] Negotiation successful
0805 22:59:52.013334 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:59:52.016355 21672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: Bootstrap starting.
I20260805 22:59:52.019048 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:52.020578 21672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:52.021960 21672 log.cc:824] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:52.025350 21672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: No bootstrap required, opened a new log
I20260805 22:59:52.022890 21421 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6afa26a357234121924acb1c9bab00f6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35666
I20260805 22:59:52.033277 21672 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } }
I20260805 22:59:52.033700 21672 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc91e9ea9d294b70b4e8f0268ccb4f70, State: Initialized, Role: FOLLOWER
I20260805 22:59:52.034185 21672 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } }
I20260805 22:59:52.035365 21684 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.035872 21684 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:52.036568 21672 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:59:52.047081 21698 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:59:52.047241 21698 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:59:52.044991 21573 master_runner.cc:186] Error getting master registration for 127.20.34.126:34953: OK, instance_id { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" instance_seqno: 1785970790745980 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:59:52.056989 21573 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:59:52.082067 21564 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 5
Aug 05 22:59:52 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970791, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
I20260805 22:59:52.099874 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:52.082861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42466)
0805 22:59:52.083084 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:52.083104 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:52.083230 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:52.083619 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:52.083625 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:52.084253 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:52.084495 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:52.084508 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.086154 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.086159 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:52.087666 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:52.087686 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.088734 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.088740 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:52.089022 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.089729 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:52.089754 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:52.092640 (+ 2886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:52.097045 (+ 4405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:52.097051 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:52.097056 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:52.097514 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:52.097954 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:52.097959 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:52.097962 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:52.098116 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:52.098798 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:52.098803 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:52.098972 (+ 169us) client_negotiation.cc:769] Sending connection context
0805 22:59:52.099124 (+ 152us) client_negotiation.cc:240] Negotiation successful
0805 22:59:52.099470 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260805 22:59:52.099887 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:52.082988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42466 (local address 127.20.34.124:40383)
0805 22:59:52.083211 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.083233 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.083259 (+ 26us) server_negotiation.cc:407] Connection header received
0805 22:59:52.083331 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.083337 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.083423 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.083537 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.084683 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.085982 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.087879 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.088545 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.088707 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.092865 (+ 4158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:52.092879 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:52.092883 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:52.092928 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:52.096881 (+ 3953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.097653 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.097659 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.097664 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.097828 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.098236 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.098243 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.098246 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.098660 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:52.098835 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:52.099244 (+ 409us) server_negotiation.cc:299] Negotiation successful
0805 22:59:52.099487 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 22:59:52.105636 21564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: Bootstrap starting.
I20260805 22:59:52.108960 21564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:52.110056 21564 log.cc:824] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:52.113226 21564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: No bootstrap required, opened a new log
I20260805 22:59:52.120656 21564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } }
I20260805 22:59:52.121032 21564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81ef4c659d524c3898d13b449678613d, State: Initialized, Role: FOLLOWER
I20260805 22:59:52.121551 21564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } }
I20260805 22:59:52.122576 21701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.122980 21701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:52.123804 21564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:59:52.135239 21718 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:59:52.135525 21718 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:59:52.132072 21463 master_runner.cc:186] Error getting master registration for 127.20.34.126:34953: OK, instance_id { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" instance_seqno: 1785970790745980 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:59:52.141358 21463 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260805 22:59:52.169006 21601 tablet.cc:2369] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:52.168967 21450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } attempt: 5
Aug 05 22:59:52 dist-test-slave-gmjp krb5kdc[21340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970790, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
I20260805 22:59:52.188302 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:52.170480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42480 (local address 127.20.34.124:40383)
0805 22:59:52.171236 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.171243 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.171266 (+ 23us) server_negotiation.cc:407] Connection header received
0805 22:59:52.171338 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.171345 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.171454 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.171576 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.172703 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.173471 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.175466 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.176019 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.176217 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.180996 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:52.181006 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:52.181013 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:52.181056 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:52.185419 (+ 4363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.186117 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.186125 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.186129 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.186302 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.186700 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.186705 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.186717 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.187103 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:52.187247 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:52.187639 (+ 392us) server_negotiation.cc:299] Negotiation successful
0805 22:59:52.187885 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601}
I20260805 22:59:52.188417 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:52.170445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:40383 (local address 127.0.0.1:42480)
0805 22:59:52.170796 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:52.170820 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:52.170967 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:52.171625 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:52.171631 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:52.172131 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:52.172508 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:52.172523 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.173649 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.173656 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:52.175295 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:52.175323 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.176235 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.176243 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:52.176493 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.177294 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:52.177328 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:52.180582 (+ 3254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:52.185568 (+ 4986us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:52.185573 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:52.185577 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:52.185979 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:52.186417 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:52.186422 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:52.186426 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:52.186582 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:52.187228 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:52.187233 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:52.187393 (+ 160us) client_negotiation.cc:769] Sending connection context
0805 22:59:52.187538 (+ 145us) client_negotiation.cc:240] Negotiation successful
0805 22:59:52.187888 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191}
I20260805 22:59:52.195231 21450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6: Bootstrap starting.
I20260805 22:59:52.199427 21450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:52.200793 21450 log.cc:824] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:52.204384 21450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6: No bootstrap required, opened a new log
I20260805 22:59:52.212451 21450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } }
I20260805 22:59:52.212891 21450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afa26a357234121924acb1c9bab00f6, State: Initialized, Role: FOLLOWER
I20260805 22:59:52.213435 21450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } }
I20260805 22:59:52.214840 21722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.215587 21722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:52.216105 21450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:52.216279 21421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 22:59:52.216467 21421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:52.220620 21421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } }
I20260805 22:59:52.223611 21527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6afa26a357234121924acb1c9bab00f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "81ef4c659d524c3898d13b449678613d"
I20260805 22:59:52.224196 21527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:52.224260 21635 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6afa26a357234121924acb1c9bab00f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70"
I20260805 22:59:52.224838 21635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:52.227866 21527 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afa26a357234121924acb1c9bab00f6 in term 1.
I20260805 22:59:52.228987 21389 leader_election.cc:302] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afa26a357234121924acb1c9bab00f6, 81ef4c659d524c3898d13b449678613d; no voters:
I20260805 22:59:52.229595 21635 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6afa26a357234121924acb1c9bab00f6 in term 1.
I20260805 22:59:52.230572 21421 leader_election.cc:288] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [CANDIDATE]: Term 1 election: Requested vote from peers 81ef4c659d524c3898d13b449678613d (127.20.34.125:43657), dc91e9ea9d294b70b4e8f0268ccb4f70 (127.20.34.124:40383)
W20260805 22:59:52.234862 21393 tablet.cc:2369] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:52.237890 21722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:52.248186 21722 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [term 1 LEADER]: Becoming Leader. State: Replica: 6afa26a357234121924acb1c9bab00f6, State: Running, Role: LEADER
I20260805 22:59:52.249554 21722 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } }
I20260805 22:59:52.267939 21727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6afa26a357234121924acb1c9bab00f6. Latest consensus state: current_term: 1 leader_uuid: "6afa26a357234121924acb1c9bab00f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.268728 21727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:52.277297 21738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:52.327371 21738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260805 22:59:52.332881 21493 tablet.cc:2369] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:52.346726 21749 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:59:52.389590 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:52.283401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35400 (local address 127.20.34.125:43657)
0805 22:59:52.283604 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.283614 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.305355 (+ 21741us) server_negotiation.cc:407] Connection header received
0805 22:59:52.305714 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.305721 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.305818 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.305906 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.312419 (+ 6513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.313749 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.332785 (+ 19036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.333531 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.333661 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.363612 (+ 29951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:52.363621 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:52.363627 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:52.363707 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:52.367737 (+ 4030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.378553 (+ 10816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.378561 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.378567 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.378779 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.385202 (+ 6423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.385209 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.385212 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.385717 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:52.386023 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:52.388831 (+ 2808us) server_negotiation.cc:299] Negotiation successful
0805 22:59:52.389151 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 22:59:52.395347 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:52.288009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50546 (local address 127.20.34.124:40383)
0805 22:59:52.288291 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.288300 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.316001 (+ 27701us) server_negotiation.cc:407] Connection header received
0805 22:59:52.319506 (+ 3505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.319515 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.319607 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.319686 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.324122 (+ 4436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.325264 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.337481 (+ 12217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.338317 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.338470 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.368973 (+ 30503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:52.368982 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:52.368988 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:52.369042 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:52.373057 (+ 4015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.384317 (+ 11260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.384326 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.384330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.384551 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.386716 (+ 2165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.386722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.386726 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.387173 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:52.387461 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:52.394469 (+ 7008us) server_negotiation.cc:299] Negotiation successful
0805 22:59:52.394861 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 22:59:52.400082 21679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:52.284613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45332 (local address 127.20.34.126:34953)
0805 22:59:52.284784 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.284790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.315121 (+ 30331us) server_negotiation.cc:407] Connection header received
0805 22:59:52.316334 (+ 1213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.316341 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.316441 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.316520 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.327643 (+ 11123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.329164 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.342601 (+ 13437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:52.343387 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:52.343502 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:52.374213 (+ 30711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:52.374220 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:52.374226 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:52.374276 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:52.378231 (+ 3955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.387593 (+ 9362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.387599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.387603 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.387777 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:52.392973 (+ 5196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:52.392980 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:52.392985 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:52.393542 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:52.393918 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:52.399327 (+ 5409us) server_negotiation.cc:299] Negotiation successful
0805 22:59:52.399650 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 22:59:52.420769 21635 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [term 1 FOLLOWER]: Refusing update from remote peer 6afa26a357234121924acb1c9bab00f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:59:52.425338 21727 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:59:52.437628 21527 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [term 1 FOLLOWER]: Refusing update from remote peer 6afa26a357234121924acb1c9bab00f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:59:52.438891 21727 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:59:52.464414 21684 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6afa26a357234121924acb1c9bab00f6. Latest consensus state: current_term: 1 leader_uuid: "6afa26a357234121924acb1c9bab00f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.464741 21684 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:52.469614 21750 mvcc.cc:205] Tried to move back new op lower bound from 7315336365710946304 to 7315336365075988480. Current Snapshot: MvccSnapshot[applied={T|T < 7315336365710946304}]
I20260805 22:59:52.470867 21701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6afa26a357234121924acb1c9bab00f6. Latest consensus state: current_term: 1 leader_uuid: "6afa26a357234121924acb1c9bab00f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.471216 21701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:52.473129 21751 mvcc.cc:205] Tried to move back new op lower bound from 7315336365710946304 to 7315336365075988480. Current Snapshot: MvccSnapshot[applied={T|T < 7315336365710946304}]
I20260805 22:59:52.480312 21754 mvcc.cc:205] Tried to move back new op lower bound from 7315336365710946304 to 7315336365075988480. Current Snapshot: MvccSnapshot[applied={T|T < 7315336365710946304}]
I20260805 22:59:52.514416 21722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6afa26a357234121924acb1c9bab00f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.514842 21722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:52.516427 21722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6afa26a357234121924acb1c9bab00f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.516750 21722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:52.519178 21701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6afa26a357234121924acb1c9bab00f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.519479 21701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:52.523375 21738 catalog_manager.cc:1347] Generated new cluster ID: f786231a5b254a84afa46e16bf28f244
I20260805 22:59:52.523483 21738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:52.536330 21684 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6afa26a357234121924acb1c9bab00f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6afa26a357234121924acb1c9bab00f6" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 34953 } } peers { permanent_uuid: "81ef4c659d524c3898d13b449678613d" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 43657 } } peers { permanent_uuid: "dc91e9ea9d294b70b4e8f0268ccb4f70" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 40383 } } }
I20260805 22:59:52.536628 21684 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:52.550028 21738 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:52.552119 21738 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:52.603204 21738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6afa26a357234121924acb1c9bab00f6: Generated new TSK 0
I20260805 22:59:52.604539 21738 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:59:52.724336 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.711280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.20.34.125:43657)
0805 22:59:52.711514 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.711520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.721921 (+ 10401us) server_negotiation.cc:407] Connection header received
0805 22:59:52.722536 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.722543 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.722646 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.722731 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.724023 (+ 1292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35416: BlockingRecv error: recv got EOF from 127.0.0.1:35416 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260805 22:59:52.727607 21679 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.710858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45346 (local address 127.20.34.126:34953)
0805 22:59:52.711121 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.711129 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.725785 (+ 14656us) server_negotiation.cc:407] Connection header received
0805 22:59:52.726090 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.726097 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.726181 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.726254 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.727328 (+ 1074us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45346: BlockingRecv error: recv got EOF from 127.0.0.1:45346 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260805 22:59:52.728798 21676 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.712887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50552 (local address 127.20.34.124:40383)
0805 22:59:52.713058 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.713064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.726582 (+ 13518us) server_negotiation.cc:407] Connection header received
0805 22:59:52.727026 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.727032 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.727127 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.727195 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.728542 (+ 1347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50552: BlockingRecv error: recv got EOF from 127.0.0.1:50552 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260805 22:59:52.737530 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.735236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35432 (local address 127.20.34.125:43657)
0805 22:59:52.735487 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.735493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.735850 (+ 357us) server_negotiation.cc:407] Connection header received
0805 22:59:52.736041 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.736046 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.736148 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.736372 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.737292 (+ 920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35432: BlockingRecv error: recv got EOF from 127.0.0.1:35432 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260805 22:59:52.743844 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.742167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35436 (local address 127.20.34.125:43657)
0805 22:59:52.742341 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.742346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.742529 (+ 183us) server_negotiation.cc:407] Connection header received
0805 22:59:52.742660 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.742665 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.742753 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.742875 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.743611 (+ 736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35436: BlockingRecv error: recv got EOF from 127.0.0.1:35436 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260805 22:59:52.751364 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.749156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35446 (local address 127.20.34.125:43657)
0805 22:59:52.749350 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.749356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.749908 (+ 552us) server_negotiation.cc:407] Connection header received
0805 22:59:52.750104 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.750107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.750177 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.750261 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.751115 (+ 854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35446: BlockingRecv error: recv got EOF from 127.0.0.1:35446 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260805 22:59:52.769299 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.766743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35454 (local address 127.20.34.125:43657)
0805 22:59:52.766990 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.766997 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.767552 (+ 555us) server_negotiation.cc:407] Connection header received
0805 22:59:52.767784 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.767791 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.767910 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.768044 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.769020 (+ 976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35454: BlockingRecv error: recv got EOF from 127.0.0.1:35454 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
W20260805 22:59:52.783547 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.781257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35460 (local address 127.20.34.125:43657)
0805 22:59:52.781557 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.781563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.781961 (+ 398us) server_negotiation.cc:407] Connection header received
0805 22:59:52.782214 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.782219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.782297 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.782380 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.783290 (+ 910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35460: BlockingRecv error: recv got EOF from 127.0.0.1:35460 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
W20260805 22:59:52.805984 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.803890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35474 (local address 127.20.34.125:43657)
0805 22:59:52.804111 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.804118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.804505 (+ 387us) server_negotiation.cc:407] Connection header received
0805 22:59:52.804674 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.804680 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.804787 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.804918 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.805746 (+ 828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35474: BlockingRecv error: recv got EOF from 127.0.0.1:35474 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260805 22:59:52.844403 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.842252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35476 (local address 127.20.34.125:43657)
0805 22:59:52.842484 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.842491 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.842806 (+ 315us) server_negotiation.cc:407] Connection header received
0805 22:59:52.842999 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.843005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.843175 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.843321 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.844124 (+ 803us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35476: BlockingRecv error: recv got EOF from 127.0.0.1:35476 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260805 22:59:52.914273 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:52.912262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35478 (local address 127.20.34.125:43657)
0805 22:59:52.912465 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:52.912470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:52.912892 (+ 422us) server_negotiation.cc:407] Connection header received
0805 22:59:52.913139 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:52.913144 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:52.913227 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:52.913346 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:52.914084 (+ 738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35478: BlockingRecv error: recv got EOF from 127.0.0.1:35478 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260805 22:59:53.048815 21680 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:53.046462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35488 (local address 127.20.34.125:43657)
0805 22:59:53.046745 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:53.046752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:53.047087 (+ 335us) server_negotiation.cc:407] Connection header received
0805 22:59:53.047272 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:53.047278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:53.047358 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:53.047455 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:53.048553 (+ 1098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35488: BlockingRecv error: recv got EOF from 127.0.0.1:35488 (error 108)
Metrics: {"server-negotiator.queue_time_us":151}
I20260805 22:59:53.049942 21698 catalog_manager.cc:1259] Loaded cluster ID: f786231a5b254a84afa46e16bf28f244
I20260805 22:59:53.050030 21698 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: loading cluster ID for follower catalog manager: success
I20260805 22:59:53.052767 21698 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: acquiring CA information for follower catalog manager: success
I20260805 22:59:53.054602 21698 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dc91e9ea9d294b70b4e8f0268ccb4f70: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:59:53.137899 21718 catalog_manager.cc:1259] Loaded cluster ID: f786231a5b254a84afa46e16bf28f244
I20260805 22:59:53.138062 21718 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: loading cluster ID for follower catalog manager: success
I20260805 22:59:53.141010 21718 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: acquiring CA information for follower catalog manager: success
I20260805 22:59:53.142844 21718 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 81ef4c659d524c3898d13b449678613d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:59:53.315971 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:53.310183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35492 (local address 127.20.34.125:43657)
0805 22:59:53.310404 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:53.310409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:53.310703 (+ 294us) server_negotiation.cc:407] Connection header received
0805 22:59:53.310881 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:53.310884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:53.311079 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:53.311206 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:53.311687 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.312465 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.313869 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.314277 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.314375 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:53.314856 (+ 481us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:53.315431 (+ 575us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:53.315544 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:53.315661 (+ 117us) server_negotiation.cc:299] Negotiation successful
0805 22:59:53.315737 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 22:59:53.329043 21870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:53.322697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50568 (local address 127.20.34.124:40383)
0805 22:59:53.323189 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:53.323194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:53.323247 (+ 53us) server_negotiation.cc:407] Connection header received
0805 22:59:53.323450 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:53.323454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:53.323724 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:53.323904 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:53.324320 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.325156 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.326493 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.327007 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.327104 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:53.327717 (+ 613us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:53.328431 (+ 714us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:53.328548 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:53.328700 (+ 152us) server_negotiation.cc:299] Negotiation successful
0805 22:59:53.328781 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":290,"threads_started":1}
I20260805 22:59:53.361097 21881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:53.341806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45362 (local address 127.20.34.126:34953)
0805 22:59:53.352101 (+ 10295us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:53.352111 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:53.353142 (+ 1031us) server_negotiation.cc:407] Connection header received
0805 22:59:53.353422 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:53.353428 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:53.353669 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:53.353877 (+ 208us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:53.354623 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.355783 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.358338 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.359017 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.359111 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:53.359842 (+ 731us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:53.360349 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:53.360427 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:53.360650 (+ 223us) server_negotiation.cc:299] Negotiation successful
0805 22:59:53.360747 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10091,"thread_start_us":10313,"threads_started":1}
I20260805 22:59:53.361379 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:53.342166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35504 (local address 127.20.34.125:43657)
0805 22:59:53.342653 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:53.342662 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:53.348566 (+ 5904us) server_negotiation.cc:407] Connection header received
0805 22:59:53.353850 (+ 5284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:53.353860 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:53.353962 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:53.354032 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:53.355066 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.356314 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.359046 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.359781 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.359877 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:53.360528 (+ 651us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:53.360642 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:53.360702 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:53.360943 (+ 241us) server_negotiation.cc:299] Negotiation successful
0805 22:59:53.361036 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311}
I20260805 22:59:53.361377 21870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:53.342400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.20.34.124:40383)
0805 22:59:53.346901 (+ 4501us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:53.346911 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:53.353900 (+ 6989us) server_negotiation.cc:407] Connection header received
0805 22:59:53.354179 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:53.354187 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:53.354284 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:53.354352 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:53.355262 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.356385 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.358974 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:53.359651 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:53.359758 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:53.360502 (+ 744us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:53.360636 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:53.360703 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:53.361001 (+ 298us) server_negotiation.cc:299] Negotiation successful
0805 22:59:53.361086 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4284}
I20260805 22:59:53.368525 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21365
I20260805 22:59:53.369686 21443 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:53.485316 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21365
I20260805 22:59:53.514856 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21463
W20260805 22:59:53.514822 21491 connection.cc:535] server connection from 127.0.0.1:33924 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:59:53.516299 21557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:53.630843 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21463
I20260805 22:59:53.662024 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21573
I20260805 22:59:53.663230 21667 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:53.776815 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21573
2026-08-05T22:59:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5353 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 22:59:53 dist-test-slave-gmjp krb5kdc[21888](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 22:59:53 dist-test-slave-gmjp krb5kdc[21888](info): set up 2 sockets
Aug 05 22:59:53 dist-test-slave-gmjp krb5kdc[21888](info): commencing operation
krb5kdc: starting...
W20260805 22:59:55.138586 20617 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/test-user.keytab.
Aug 05 22:59:55 dist-test-slave-gmjp krb5kdc[21888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T22:59:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T22:59:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.34.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
Entry for principal kudu/127.20.34.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab.
I20260805 22:59:55.532140 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42471
--webserver_interface=127.20.34.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:42471,127.20.34.125:40269,127.20.34.124:36829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 22:59:55.906466 21906 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:59:55.906795 21906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:55.906915 21906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:55.907060 21906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:55.914752 21906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:55.914871 21906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:55.914933 21906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:55.915056 21906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:55.915153 21906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:55.925498 21906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:42471,127.20.34.125:40269,127.20.34.124:36829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.126.keytab
--principal=kudu/127.20.34.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.126:42471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.34.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:55.926995 21906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:55.928472 21906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:55.941496 21913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:55.941597 21914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:55.941854 21917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:55.942818 21906 server_base.cc:1034] running on GCE node
I20260805 22:59:55.943656 21906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:55.945322 21906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:55.946578 21906 hybrid_clock.cc:648] HybridClock initialized: now 1785970795946504 us; error 37 us; skew 500 ppm
I20260805 22:59:55.946906 21906 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:55 dist-test-slave-gmjp krb5kdc[21888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970795, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:55.950178 21906 init.cc:377] Logged in from keytab as kudu/127.20.34.126@KRBTEST.COM (short username kudu)
I20260805 22:59:55.951736 21906 webserver.cc:460] Webserver started at http://127.20.34.126:37801/ using document root <none> and password file <none>
I20260805 22:59:55.952538 21906 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:55.952631 21906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:55.952910 21906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:55.956085 21906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/data/instance:
uuid: "03d1faf30929450b8002a6da3617df11"
format_stamp: "Formatted at 2026-08-05 22:59:55 on dist-test-slave-gmjp"
server_key: "d2650661739cf788e9ffde4875dc1f11"
server_key_iv: "f6e0f22dbc3ecb8eed7a16fc244d7f2d"
server_key_version: "encryptionkey@0"
I20260805 22:59:55.957005 21906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/wal/instance:
uuid: "03d1faf30929450b8002a6da3617df11"
format_stamp: "Formatted at 2026-08-05 22:59:55 on dist-test-slave-gmjp"
server_key: "d2650661739cf788e9ffde4875dc1f11"
server_key_iv: "f6e0f22dbc3ecb8eed7a16fc244d7f2d"
server_key_version: "encryptionkey@0"
I20260805 22:59:55.962713 21906 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 22:59:55.966610 21930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:55.968037 21906 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 22:59:55.968307 21906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/wal
uuid: "03d1faf30929450b8002a6da3617df11"
format_stamp: "Formatted at 2026-08-05 22:59:55 on dist-test-slave-gmjp"
server_key: "d2650661739cf788e9ffde4875dc1f11"
server_key_iv: "f6e0f22dbc3ecb8eed7a16fc244d7f2d"
server_key_version: "encryptionkey@0"
I20260805 22:59:55.968519 21906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:55.995426 21906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:55.999936 21906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:56.000291 21906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:56.019768 21906 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.126:42471
I20260805 22:59:56.019790 22011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.126:42471 every 8 connection(s)
I20260805 22:59:56.021266 21906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/data/info.pb
I20260805 22:59:56.022164 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 21906
I20260805 22:59:56.022372 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-0/wal/instance
I20260805 22:59:56.022967 20617 external_mini_cluster.cc:1428] Setting key f84f2c4b59b6dda2c3d5f4625ff6353b
I20260805 22:59:56.026213 22013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:56.037036 22013 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:56 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970795, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.34.125@KRBTEST.COM; defaulting to no policy
I20260805 22:59:56.063129 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.041554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:42471 (local address 127.0.0.1:52146)
0805 22:59:56.042660 (+ 1106us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.042715 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:56.044769 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:56.045854 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:56.045862 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:56.046706 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:56.047082 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:56.047101 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.048868 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.048878 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:56.049979 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:56.049991 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.050973 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.050980 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:56.051166 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:56.051884 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:56.051916 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:56.054627 (+ 2711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:56.058408 (+ 3781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:56.058421 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:56.058454 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:56.058854 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:56.059312 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:56.059317 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:56.059321 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:56.059492 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:56.060428 (+ 936us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:56.060436 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:56.060672 (+ 236us) client_negotiation.cc:769] Sending connection context
0805 22:59:56.060948 (+ 276us) client_negotiation.cc:240] Negotiation successful
0805 22:59:56.061589 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"mutex_wait_us":160,"thread_start_us":458,"threads_started":1}
I20260805 22:59:56.063170 22019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.041554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52146 (local address 127.20.34.126:42471)
0805 22:59:56.042604 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:56.042625 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:56.042875 (+ 250us) server_negotiation.cc:407] Connection header received
0805 22:59:56.045243 (+ 2368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:56.045253 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:56.045595 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:56.045841 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:56.047335 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.048696 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.050132 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.050712 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.050933 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:56.054885 (+ 3952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:56.054901 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:56.054917 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:56.054953 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:56.058227 (+ 3274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:56.059018 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:56.059025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:56.059028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:56.059188 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:56.059609 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:56.059617 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:56.059620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:56.060271 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:56.060491 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:56.061054 (+ 563us) server_negotiation.cc:299] Negotiation successful
0805 22:59:56.061489 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":811,"spinlock_wait_cycles":48512,"thread_start_us":552,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.125@KRBTEST.COM" created.
I20260805 22:59:56.066623 22013 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:59:56.067857 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.067323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39498)
0805 22:59:56.067536 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.067684 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260805 22:59:56.068193 21933 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
I20260805 22:59:56.070066 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.069571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39510)
0805 22:59:56.069786 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.069881 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260805 22:59:56.070282 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:40269: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab.
Entry for principal kudu/127.20.34.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab.
I20260805 22:59:56.108661 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.125:40269
--webserver_interface=127.20.34.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab
--principal=kudu/127.20.34.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:42471,127.20.34.125:40269,127.20.34.124:36829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:59:56.119711 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } attempt: 1
I20260805 22:59:56.121217 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.120568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39520)
0805 22:59:56.120846 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.121006 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260805 22:59:56.122381 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.121928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39534)
0805 22:59:56.122119 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.122215 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260805 22:59:56.122643 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:40269: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
I20260805 22:59:56.190985 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } attempt: 2
I20260805 22:59:56.192430 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.191776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39536)
0805 22:59:56.192078 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.192270 (+ 192us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260805 22:59:56.193622 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.193202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39552)
0805 22:59:56.193380 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.193477 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260805 22:59:56.193856 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:40269: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
I20260805 22:59:56.285254 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } attempt: 3
I20260805 22:59:56.286500 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.286004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39564)
0805 22:59:56.286238 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.286346 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260805 22:59:56.287829 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.287357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39574)
0805 22:59:56.287566 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.287661 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260805 22:59:56.288075 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:40269: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
I20260805 22:59:56.431391 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } attempt: 4
I20260805 22:59:56.432825 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.432243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39584)
0805 22:59:56.432590 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.432682 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
I20260805 22:59:56.433959 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.433576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39596)
0805 22:59:56.433741 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.433805 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260805 22:59:56.434146 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.125:40269: Network error: Client connection negotiation failed: client connection to 127.20.34.125:40269: connect: Connection refused (error 111)
W20260805 22:59:56.492617 22023 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:59:56.493084 22023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:56.493224 22023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:56.493369 22023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:56.500921 22023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:56.501088 22023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:56.501199 22023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:56.501295 22023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:56.501417 22023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:56.511590 22023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:42471,127.20.34.125:40269,127.20.34.124:36829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.125.keytab
--principal=kudu/127.20.34.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.125:40269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.34.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:56.513156 22023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:56.514575 22023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:56.527370 22031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:56.527392 22033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:56.527597 22035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:56.528141 22023 server_base.cc:1034] running on GCE node
I20260805 22:59:56.529095 22023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:56.530689 22023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:56.531955 22023 hybrid_clock.cc:648] HybridClock initialized: now 1785970796531890 us; error 69 us; skew 500 ppm
I20260805 22:59:56.532366 22023 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:56 dist-test-slave-gmjp krb5kdc[21888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970796, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:56.541570 22023 init.cc:377] Logged in from keytab as kudu/127.20.34.125@KRBTEST.COM (short username kudu)
I20260805 22:59:56.543164 22023 webserver.cc:460] Webserver started at http://127.20.34.125:43303/ using document root <none> and password file <none>
I20260805 22:59:56.543890 22023 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:56.543985 22023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:56.544368 22023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:56.547681 22023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/data/instance:
uuid: "2ef5a68acd954f329c17cb0e972c5896"
format_stamp: "Formatted at 2026-08-05 22:59:56 on dist-test-slave-gmjp"
server_key: "dc90345551c927d8cceb8fa6db277ad4"
server_key_iv: "fd71f25c220e506db653684fbb5fa487"
server_key_version: "encryptionkey@0"
I20260805 22:59:56.548596 22023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/wal/instance:
uuid: "2ef5a68acd954f329c17cb0e972c5896"
format_stamp: "Formatted at 2026-08-05 22:59:56 on dist-test-slave-gmjp"
server_key: "dc90345551c927d8cceb8fa6db277ad4"
server_key_iv: "fd71f25c220e506db653684fbb5fa487"
server_key_version: "encryptionkey@0"
I20260805 22:59:56.554075 22023 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 22:59:56.557752 22043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:56.559113 22023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 22:59:56.559322 22023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/wal
uuid: "2ef5a68acd954f329c17cb0e972c5896"
format_stamp: "Formatted at 2026-08-05 22:59:56 on dist-test-slave-gmjp"
server_key: "dc90345551c927d8cceb8fa6db277ad4"
server_key_iv: "fd71f25c220e506db653684fbb5fa487"
server_key_version: "encryptionkey@0"
I20260805 22:59:56.559571 22023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:56.581669 22023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 22:59:56.586625 22023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:56.586962 22023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:56.607276 22023 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.125:40269
I20260805 22:59:56.607296 22111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.125:40269 every 8 connection(s)
I20260805 22:59:56.608821 22023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/data/info.pb
I20260805 22:59:56.612252 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 22023
I20260805 22:59:56.612490 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-1/wal/instance
I20260805 22:59:56.612937 22112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:56.612967 20617 external_mini_cluster.cc:1428] Setting key f6ba1e7f7be30df2e6c1a58cf10d50fe
I20260805 22:59:56.619663 22112 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:56 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970796, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:56.647722 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.622444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52154 (local address 127.20.34.126:42471)
0805 22:59:56.622974 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:56.622979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:56.624087 (+ 1108us) server_negotiation.cc:407] Connection header received
0805 22:59:56.626059 (+ 1972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:56.626065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:56.626158 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:56.626288 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:56.628190 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.629368 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.632041 (+ 2673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.632551 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.632666 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:56.637580 (+ 4914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:56.637589 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:56.637593 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:56.637658 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:56.641821 (+ 4163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:56.643004 (+ 1183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:56.643012 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:56.643017 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:56.643345 (+ 328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:56.643989 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:56.643995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:56.643999 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:56.644559 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:56.644729 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:56.646933 (+ 2204us) server_negotiation.cc:299] Negotiation successful
0805 22:59:56.647204 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":292,"threads_started":1}
I20260805 22:59:56.649329 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.623095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:42471 (local address 127.0.0.1:52154)
0805 22:59:56.623913 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.623952 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:56.625760 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:56.626541 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:56.626550 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:56.627126 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:56.627861 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:56.627887 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.629599 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.629606 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:56.631841 (+ 2235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:56.631863 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.632804 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.632814 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:56.633195 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:56.634009 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:56.634045 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:56.637257 (+ 3212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:56.642012 (+ 4755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:56.642025 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:56.642047 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:56.642785 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:56.643526 (+ 741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:56.643533 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:56.643540 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:56.643795 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:56.644737 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:56.644749 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:56.645323 (+ 574us) client_negotiation.cc:769] Sending connection context
0805 22:59:56.645690 (+ 367us) client_negotiation.cc:240] Negotiation successful
0805 22:59:56.646395 (+ 705us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":334,"threads_started":1}
I20260805 22:59:56.651322 22112 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.34.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.34.124@KRBTEST.COM" created.
Aug 05 22:59:56 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970796, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:59:56.667552 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.652375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39610 (local address 127.20.34.125:40269)
0805 22:59:56.653015 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:56.653021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:56.653048 (+ 27us) server_negotiation.cc:407] Connection header received
0805 22:59:56.653096 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:56.653102 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:56.653280 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:56.653399 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:56.654404 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.655451 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.656742 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.657372 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.657525 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:56.661012 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:56.661025 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:56.661040 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:56.661070 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:56.664492 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:56.665365 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:56.665372 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:56.665374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:56.665508 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:56.665949 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:56.665952 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:56.665954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:56.666306 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:56.666484 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:56.666902 (+ 418us) server_negotiation.cc:299] Negotiation successful
0805 22:59:56.667221 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":99,"server-negotiator.queue_time_us":478,"thread_start_us":324,"threads_started":1}
I20260805 22:59:56.667579 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.652108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39610)
0805 22:59:56.652379 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.652412 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:56.652535 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:56.653495 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:56.653508 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:56.653987 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:56.654210 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:56.654224 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.655624 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.655628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:56.656616 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:56.656628 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.657533 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.657538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:56.657741 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:56.658368 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:56.658387 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:56.660777 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:56.664637 (+ 3860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:56.664645 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:56.664651 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:56.665222 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:56.665641 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:56.665648 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:56.665654 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:56.665823 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:56.666438 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:56.666445 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:56.666610 (+ 165us) client_negotiation.cc:769] Sending connection context
0805 22:59:56.666755 (+ 145us) client_negotiation.cc:240] Negotiation successful
0805 22:59:56.667099 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260805 22:59:56.670162 22112 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:59:56.671479 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.670916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54640)
0805 22:59:56.671128 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.671280 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260805 22:59:56.671792 22047 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:56.673604 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.673125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54652)
0805 22:59:56.673342 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.673461 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260805 22:59:56.673859 22112 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.34.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab.
Entry for principal kudu/127.20.34.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab.
I20260805 22:59:56.700419 20617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
/tmp/dist-test-taskj1qIwm/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.124:36829
--webserver_interface=127.20.34.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab
--principal=kudu/127.20.34.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.34.84:45451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.34.126:42471,127.20.34.125:40269,127.20.34.124:36829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 22:59:56.723225 22112 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 1
I20260805 22:59:56.724606 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.724067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54658)
0805 22:59:56.724333 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.724446 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260805 22:59:56.725720 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.725371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54668)
0805 22:59:56.725543 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.725618 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260805 22:59:56.725999 22112 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:56.733390 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } attempt: 5
Aug 05 22:59:56 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970795, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:59:56.748909 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.734202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39622)
0805 22:59:56.734448 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.734472 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:56.734660 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:56.735053 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:56.735058 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:56.735481 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:56.735675 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:56.735683 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.736892 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.736899 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:56.737762 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:56.737773 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.738570 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.738576 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:56.738796 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:56.740442 (+ 1646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:56.740470 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:56.742837 (+ 2367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:56.746160 (+ 3323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:56.746167 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:56.746171 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:56.746574 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:56.747087 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:56.747093 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:56.747097 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:56.747250 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:56.747842 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:56.747846 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:56.748012 (+ 166us) client_negotiation.cc:769] Sending connection context
0805 22:59:56.748194 (+ 182us) client_negotiation.cc:240] Negotiation successful
0805 22:59:56.748543 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260805 22:59:56.748906 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.734290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39622 (local address 127.20.34.125:40269)
0805 22:59:56.734462 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:56.734470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:56.734581 (+ 111us) server_negotiation.cc:407] Connection header received
0805 22:59:56.734824 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:56.734828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:56.734894 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:56.735022 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:56.735842 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.736751 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.737940 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:56.738372 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:56.738555 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:56.743072 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:56.743077 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:56.743080 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:56.743115 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:56.745991 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:56.746712 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:56.746719 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:56.746722 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:56.746889 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:56.747378 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:56.747384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:56.747387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:56.747692 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:56.747863 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:56.748304 (+ 441us) server_negotiation.cc:299] Negotiation successful
0805 22:59:56.748545 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:59:56.750397 22013 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } has no permanent_uuid. Determining permanent_uuid...
I20260805 22:59:56.751549 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.751140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54676)
0805 22:59:56.751314 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.751392 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260805 22:59:56.752473 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.752127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54684)
0805 22:59:56.752286 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.752374 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260805 22:59:56.752682 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:56.794240 22112 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 2
I20260805 22:59:56.795536 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.795046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54694)
0805 22:59:56.795255 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.795353 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260805 22:59:56.796677 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.796317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54704)
0805 22:59:56.796486 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.796558 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260805 22:59:56.796900 22112 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:56.803925 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 1
I20260805 22:59:56.805106 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.804633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54712)
0805 22:59:56.804832 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.804940 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260805 22:59:56.806113 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.805782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54728)
0805 22:59:56.805933 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.806012 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 22:59:56.806320 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:56.874526 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 2
I20260805 22:59:56.875777 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.875242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54730)
0805 22:59:56.875500 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.875601 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260805 22:59:56.876909 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.876533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54744)
0805 22:59:56.876723 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.876798 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260805 22:59:56.877122 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:56.888324 22112 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 3
I20260805 22:59:56.889703 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.889132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54750)
0805 22:59:56.889402 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.889513 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260805 22:59:56.890934 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.890446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54756)
0805 22:59:56.890719 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.890804 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
W20260805 22:59:56.891170 22112 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:56.983376 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 3
I20260805 22:59:56.984793 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.984104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54770)
0805 22:59:56.984431 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.984556 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260805 22:59:56.986043 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:56.985563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54776)
0805 22:59:56.985802 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:56.985894 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260805 22:59:56.986305 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:57.034443 22112 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 4
I20260805 22:59:57.035697 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.035180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54788)
0805 22:59:57.035448 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.035534 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260805 22:59:57.036852 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.036531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54796)
0805 22:59:57.036674 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.036745 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 22:59:57.037110 22112 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
W20260805 22:59:57.084074 22124 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 22:59:57.084539 22124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 22:59:57.084661 22124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 22:59:57.084798 22124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 22:59:57.092530 22124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 22:59:57.092619 22124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 22:59:57.092741 22124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 22:59:57.092830 22124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 22:59:57.092979 22124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 22:59:57.103396 22124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.34.84:45451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.34.126:42471,127.20.34.125:40269,127.20.34.124:36829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/krb5kdc/kudu_127.20.34.124.keytab
--principal=kudu/127.20.34.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.34.124:36829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.34.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 22:59:57.104875 22124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 22:59:57.106370 22124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 22:59:57.118999 22136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:57.119124 22132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 22:59:57.119084 22133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 22:59:57.120438 22124 server_base.cc:1034] running on GCE node
I20260805 22:59:57.121321 22124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 22:59:57.122773 22124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 22:59:57.124045 22124 hybrid_clock.cc:648] HybridClock initialized: now 1785970797123985 us; error 70 us; skew 500 ppm
I20260805 22:59:57.124475 22124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970797, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 22:59:57.127628 22124 init.cc:377] Logged in from keytab as kudu/127.20.34.124@KRBTEST.COM (short username kudu)
I20260805 22:59:57.129230 22124 webserver.cc:460] Webserver started at http://127.20.34.124:33449/ using document root <none> and password file <none>
I20260805 22:59:57.129983 22124 fs_manager.cc:359] Metadata directory not provided
I20260805 22:59:57.130124 22124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 22:59:57.130470 22124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 22:59:57.133675 22124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/data/instance:
uuid: "4c60b6f3e65046b886bb11dbbf63c96b"
format_stamp: "Formatted at 2026-08-05 22:59:57 on dist-test-slave-gmjp"
server_key: "b7c7bb72192608846f4adc878e80799f"
server_key_iv: "6b5fcda468263c1ed1555bcca478add3"
server_key_version: "encryptionkey@0"
I20260805 22:59:57.134537 22124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/wal/instance:
uuid: "4c60b6f3e65046b886bb11dbbf63c96b"
format_stamp: "Formatted at 2026-08-05 22:59:57 on dist-test-slave-gmjp"
server_key: "b7c7bb72192608846f4adc878e80799f"
server_key_iv: "6b5fcda468263c1ed1555bcca478add3"
server_key_version: "encryptionkey@0"
I20260805 22:59:57.140043 22124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260805 22:59:57.143731 22149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 22:59:57.145217 22124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 22:59:57.145426 22124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/data,/tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/wal
uuid: "4c60b6f3e65046b886bb11dbbf63c96b"
format_stamp: "Formatted at 2026-08-05 22:59:57 on dist-test-slave-gmjp"
server_key: "b7c7bb72192608846f4adc878e80799f"
server_key_iv: "6b5fcda468263c1ed1555bcca478add3"
server_key_version: "encryptionkey@0"
I20260805 22:59:57.145673 22124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 22:59:57.163527 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 4
I20260805 22:59:57.164742 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.164264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54802)
0805 22:59:57.164491 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.164592 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260805 22:59:57.165745 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.165390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54808)
0805 22:59:57.165552 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.165627 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260805 22:59:57.165916 22124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
W20260805 22:59:57.165964 22013 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.34.124:36829: Network error: Client connection negotiation failed: client connection to 127.20.34.124:36829: connect: Connection refused (error 111)
I20260805 22:59:57.170148 22124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 22:59:57.170439 22124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 22:59:57.193518 22124 rpc_server.cc:307] RPC server started. Bound to: 127.20.34.124:36829
I20260805 22:59:57.193536 22221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.34.124:36829 every 8 connection(s)
I20260805 22:59:57.194996 22124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/data/info.pb
I20260805 22:59:57.199138 22222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 22:59:57.201038 20617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu as pid 22124
I20260805 22:59:57.201241 20617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskj1qIwm/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970399628623-20617-0/minicluster-data/master-2/wal/instance
I20260805 22:59:57.201853 20617 external_mini_cluster.cc:1428] Setting key 9ded9158330c22ae4560f6ada4aa53b5
I20260805 22:59:57.209748 22222 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970797, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:57.226274 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.203787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54814 (local address 127.20.34.124:36829)
0805 22:59:57.204731 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.204742 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.204790 (+ 48us) server_negotiation.cc:407] Connection header received
0805 22:59:57.206408 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.206434 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.206887 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.207246 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.209147 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.210487 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.211868 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.212817 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.213027 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.217708 (+ 4681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.217717 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.217729 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.217770 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.221385 (+ 3615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.222190 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.222202 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.222215 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.222368 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.222856 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.222864 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.222867 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.223636 (+ 769us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.223941 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.224484 (+ 543us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.224918 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":447,"threads_started":1}
I20260805 22:59:57.228590 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.212581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52162 (local address 127.20.34.126:42471)
0805 22:59:57.213135 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.213144 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.213925 (+ 781us) server_negotiation.cc:407] Connection header received
0805 22:59:57.214146 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.214156 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.214221 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.214344 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.215480 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.216264 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.217674 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.218083 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.218180 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.222103 (+ 3923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.222108 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.222111 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.222150 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.225549 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.226254 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.226262 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.226266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.226431 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.226879 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.226883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.226885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.227189 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.227307 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.227875 (+ 568us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.228106 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":259,"threads_started":1}
I20260805 22:59:57.228595 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.212557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.126:42471 (local address 127.0.0.1:52162)
0805 22:59:57.213747 (+ 1190us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.213808 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:57.213995 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:57.214407 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:57.214415 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:57.215066 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:57.215317 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.215326 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.216417 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.216423 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.217480 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.217524 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.218290 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.218300 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.218461 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.219041 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:57.219082 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:57.221912 (+ 2830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:57.225689 (+ 3777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.225699 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.225704 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.226122 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.226594 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.226602 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.226606 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.226760 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.227325 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:57.227332 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:57.227571 (+ 239us) client_negotiation.cc:769] Sending connection context
0805 22:59:57.227774 (+ 203us) client_negotiation.cc:240] Negotiation successful
0805 22:59:57.228102 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"thread_start_us":713,"threads_started":1}
I20260805 22:59:57.230405 22222 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970797, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.126@KRBTEST.COM
I20260805 22:59:57.245152 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.231091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.125:40269 (local address 127.0.0.1:39628)
0805 22:59:57.231341 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.231356 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:57.231441 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:57.231755 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:57.231759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:57.232265 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:57.232474 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.232488 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.233667 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.233671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.234790 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.234805 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.235806 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.235813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.235996 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.236544 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:57.236560 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:57.238705 (+ 2145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:57.242559 (+ 3854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.242563 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.242565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.242967 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.243382 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.243388 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.243399 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.243547 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.244117 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:57.244122 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:57.244311 (+ 189us) client_negotiation.cc:769] Sending connection context
0805 22:59:57.244473 (+ 162us) client_negotiation.cc:240] Negotiation successful
0805 22:59:57.244767 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138}
I20260805 22:59:57.245190 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.231249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39628 (local address 127.20.34.125:40269)
0805 22:59:57.231452 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.231459 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.231481 (+ 22us) server_negotiation.cc:407] Connection header received
0805 22:59:57.231542 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.231546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.231621 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.231731 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.232627 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.233521 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.234950 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.235649 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.235792 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.238913 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.238918 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.238921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.238952 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.242418 (+ 3466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.243094 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.243100 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.243103 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.243257 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.243670 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.243676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.243679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.243983 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.244158 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.244577 (+ 419us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.244793 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 22:59:57.246011 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.229848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52166 (local address 127.20.34.126:42471)
0805 22:59:57.230010 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.230016 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.230033 (+ 17us) server_negotiation.cc:407] Connection header received
0805 22:59:57.230145 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.230150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.230227 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.230335 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.231935 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.232904 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.234318 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.234974 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.235072 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.239757 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.239766 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.239773 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.239813 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.242983 (+ 3170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.243666 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.243674 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.243677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.243815 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.244265 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.244271 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.244275 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.244582 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.244885 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.245384 (+ 499us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.245660 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 22:59:57.246635 22222 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970797, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.124@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970795, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.34.125@KRBTEST.COM
I20260805 22:59:57.260286 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.247500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54828 (local address 127.20.34.124:36829)
0805 22:59:57.247685 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.247691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.247937 (+ 246us) server_negotiation.cc:407] Connection header received
0805 22:59:57.248180 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.248186 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.248258 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.248327 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.249182 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.249923 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.251157 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.251552 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.251700 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.254878 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.254883 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.254886 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.254915 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.257692 (+ 2777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.258322 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.258329 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.258333 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.258468 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.258837 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.258844 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.258847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.259112 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.259270 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.259620 (+ 350us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.259840 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 22:59:57.260501 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.247671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54828)
0805 22:59:57.247834 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.247854 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:57.248029 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:57.248517 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:57.248520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:57.248854 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:57.249049 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.249059 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.250046 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.250054 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.251021 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.251033 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.251716 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.251722 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.251911 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.252497 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:57.252521 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:57.254695 (+ 2174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:57.257832 (+ 3137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.257839 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.257843 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.258200 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.258586 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.258593 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.258598 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.258729 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.259233 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:57.259238 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:57.259378 (+ 140us) client_negotiation.cc:769] Sending connection context
0805 22:59:57.259544 (+ 166us) client_negotiation.cc:240] Negotiation successful
0805 22:59:57.260007 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":144}
I20260805 22:59:57.263561 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.248121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39632 (local address 127.20.34.125:40269)
0805 22:59:57.248307 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.248313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.248329 (+ 16us) server_negotiation.cc:407] Connection header received
0805 22:59:57.248515 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.248520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.248596 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.248702 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.250093 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.250970 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.252244 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.252903 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.253056 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.257613 (+ 4557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.257619 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.257624 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.257663 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.260502 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.261380 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.261385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.261389 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.261570 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.261966 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.261971 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.261975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.262366 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.262598 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.262992 (+ 394us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.263180 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 22:59:57.267127 22222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: Bootstrap starting.
I20260805 22:59:57.269011 20617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 22:59:57.270987 22222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:57.272432 22222 log.cc:824] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:57.271349 21969 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "03d1faf30929450b8002a6da3617df11"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52166
I20260805 22:59:57.275856 22222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: No bootstrap required, opened a new log
I20260805 22:59:57.286993 22222 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } }
I20260805 22:59:57.287444 22222 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c60b6f3e65046b886bb11dbbf63c96b, State: Initialized, Role: FOLLOWER
I20260805 22:59:57.287981 22222 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } }
I20260805 22:59:57.289011 22233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.289358 22233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:57.290366 22222 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:59:57.301339 22251 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:59:57.301488 22251 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:59:57.298812 22124 master_runner.cc:186] Error getting master registration for 127.20.34.126:42471: OK, instance_id { permanent_uuid: "03d1faf30929450b8002a6da3617df11" instance_seqno: 1785970796014298 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:59:57.308048 22124 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 22:59:57.336349 22112 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 5
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970796, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.125@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
I20260805 22:59:57.354384 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.337196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54834)
0805 22:59:57.337468 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.337495 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:57.337636 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:57.338227 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:57.338235 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:57.338796 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:57.339031 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.339045 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.340596 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.340602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.342027 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.342044 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.343082 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.343089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.343309 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.343986 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:57.344012 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:57.346882 (+ 2870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:57.351417 (+ 4535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.351423 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.351427 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.352015 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.352466 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.352470 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.352474 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.352654 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.353327 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:57.353332 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:57.353489 (+ 157us) client_negotiation.cc:769] Sending connection context
0805 22:59:57.353643 (+ 154us) client_negotiation.cc:240] Negotiation successful
0805 22:59:57.353996 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260805 22:59:57.354393 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.337576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54834 (local address 127.20.34.124:36829)
0805 22:59:57.337855 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.337863 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.337887 (+ 24us) server_negotiation.cc:407] Connection header received
0805 22:59:57.337956 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.337961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.338041 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.338152 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.339194 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.340435 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.342181 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.342904 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.343039 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.347146 (+ 4107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.347156 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.347162 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.347206 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.351228 (+ 4022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.352173 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.352180 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.352184 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.352333 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.352776 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.352781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.352787 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.353185 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.353329 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.353764 (+ 435us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.354003 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260805 22:59:57.360126 22112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: Bootstrap starting.
I20260805 22:59:57.363631 22112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:57.365034 22112 log.cc:824] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:57.367966 22112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: No bootstrap required, opened a new log
I20260805 22:59:57.375577 22112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } }
I20260805 22:59:57.375941 22112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef5a68acd954f329c17cb0e972c5896, State: Initialized, Role: FOLLOWER
I20260805 22:59:57.376508 22112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } }
I20260805 22:59:57.377568 22257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.378000 22257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:57.378865 22112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [sys.catalog]: configured and running, proceeding with master startup.
W20260805 22:59:57.389242 22274 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 22:59:57.389487 22274 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 22:59:57.386694 22023 master_runner.cc:186] Error getting master registration for 127.20.34.126:42471: OK, instance_id { permanent_uuid: "03d1faf30929450b8002a6da3617df11" instance_seqno: 1785970796014298 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 22:59:57.398906 22023 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260805 22:59:57.422783 22159 tablet.cc:2369] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:57.443212 22013 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } attempt: 5
Aug 05 22:59:57 dist-test-slave-gmjp krb5kdc[21888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970795, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.34.126@KRBTEST.COM for kudu/127.20.34.124@KRBTEST.COM
I20260805 22:59:57.462086 22016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.444080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.34.124:36829 (local address 127.0.0.1:54836)
0805 22:59:57.444430 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0805 22:59:57.444455 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 22:59:57.444595 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 22:59:57.445080 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 22:59:57.445085 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 22:59:57.445670 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0805 22:59:57.445907 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.445932 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.447470 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.447477 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.449022 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 22:59:57.449039 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.450306 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.450313 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 22:59:57.450527 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.451263 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 22:59:57.451288 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 22:59:57.454283 (+ 2995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 22:59:57.458807 (+ 4524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.458813 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.458817 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.459371 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.459902 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 22:59:57.459907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 22:59:57.459911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 22:59:57.460141 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 22:59:57.460936 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 22:59:57.460941 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 22:59:57.461129 (+ 188us) client_negotiation.cc:769] Sending connection context
0805 22:59:57.461285 (+ 156us) client_negotiation.cc:240] Negotiation successful
0805 22:59:57.461601 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215}
I20260805 22:59:57.463135 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.444303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54836 (local address 127.20.34.124:36829)
0805 22:59:57.444504 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.444511 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.444535 (+ 24us) server_negotiation.cc:407] Connection header received
0805 22:59:57.444761 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.444767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.444855 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.444991 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.446111 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.447291 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.449223 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.449932 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.450071 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.454542 (+ 4471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.454549 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.454554 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.454598 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.458588 (+ 3990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.459535 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.459541 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.459545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.459747 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.460312 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.460318 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.460321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.460696 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.460854 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.462470 (+ 1616us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.462748 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 22:59:57.470003 22013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11: Bootstrap starting.
I20260805 22:59:57.474392 22013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11: Neither blocks nor log segments found. Creating new log.
I20260805 22:59:57.475827 22013 log.cc:824] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11: Log is configured to *not* fsync() on all Append() calls
I20260805 22:59:57.479857 22013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11: No bootstrap required, opened a new log
I20260805 22:59:57.488117 22013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } }
I20260805 22:59:57.488655 22013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03d1faf30929450b8002a6da3617df11, State: Initialized, Role: FOLLOWER
I20260805 22:59:57.489223 22013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } }
I20260805 22:59:57.496496 22280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.496968 22280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:57.498941 22013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 22:59:57.499063 21969 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 22:59:57.499374 21969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:57.502943 21969 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } }
W20260805 22:59:57.503464 21940 tablet.cc:2369] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:57.505270 21969 leader_election.cc:288] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [CANDIDATE]: Term 1 election: Requested vote from peers 2ef5a68acd954f329c17cb0e972c5896 (127.20.34.125:40269), 4c60b6f3e65046b886bb11dbbf63c96b (127.20.34.124:36829)
I20260805 22:59:57.505611 22081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03d1faf30929450b8002a6da3617df11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2ef5a68acd954f329c17cb0e972c5896"
I20260805 22:59:57.506140 22081 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:57.509337 22189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "03d1faf30929450b8002a6da3617df11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4c60b6f3e65046b886bb11dbbf63c96b"
I20260805 22:59:57.509869 22189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [term 0 FOLLOWER]: Advancing to term 1
I20260805 22:59:57.511085 22081 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d1faf30929450b8002a6da3617df11 in term 1.
I20260805 22:59:57.511837 21933 leader_election.cc:302] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03d1faf30929450b8002a6da3617df11, 2ef5a68acd954f329c17cb0e972c5896; no voters:
I20260805 22:59:57.514163 22280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 22:59:57.514251 22189 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03d1faf30929450b8002a6da3617df11 in term 1.
I20260805 22:59:57.530138 22280 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [term 1 LEADER]: Becoming Leader. State: Replica: 03d1faf30929450b8002a6da3617df11, State: Running, Role: LEADER
I20260805 22:59:57.531173 22280 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } }
I20260805 22:59:57.541637 22283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03d1faf30929450b8002a6da3617df11. Latest consensus state: current_term: 1 leader_uuid: "03d1faf30929450b8002a6da3617df11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.542135 22283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:57.548585 22290 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 22:59:57.576741 22290 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260805 22:59:57.591145 22054 tablet.cc:2369] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 22:59:57.632297 22310 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 22:59:57.650272 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.562713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54848 (local address 127.20.34.124:36829)
0805 22:59:57.562968 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.562974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.568941 (+ 5967us) server_negotiation.cc:407] Connection header received
0805 22:59:57.571848 (+ 2907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.571859 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.571978 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.572059 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.592067 (+ 20008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.593194 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.601815 (+ 8621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.602589 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.602729 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.634391 (+ 31662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.634399 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.634405 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.634462 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.638579 (+ 4117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.639576 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.639582 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.639587 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.639734 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.640214 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.640220 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.640224 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.640683 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.640934 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.649495 (+ 8561us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.649819 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260805 22:59:57.651743 22189 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [term 1 FOLLOWER]: Refusing update from remote peer 03d1faf30929450b8002a6da3617df11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:59:57.652827 22283 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:59:57.665241 22228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.563947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52174 (local address 127.20.34.126:42471)
0805 22:59:57.564200 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.564210 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.570775 (+ 6565us) server_negotiation.cc:407] Connection header received
0805 22:59:57.573602 (+ 2827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.573608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.573692 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.573765 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.589560 (+ 15795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.590743 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.603726 (+ 12983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.604488 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.604607 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.626938 (+ 22331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.626947 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.626952 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.627027 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.630926 (+ 3899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.649620 (+ 18694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.649628 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.649634 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.649814 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.650920 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.650926 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.650929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.651338 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.651599 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.664467 (+ 12868us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.664801 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 22:59:57.669910 22081 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [term 1 FOLLOWER]: Refusing update from remote peer 03d1faf30929450b8002a6da3617df11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 22:59:57.671005 22283 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 22:59:57.677690 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:57.569479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39648 (local address 127.20.34.125:40269)
0805 22:59:57.569649 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.569654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.571430 (+ 1776us) server_negotiation.cc:407] Connection header received
0805 22:59:57.574003 (+ 2573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.574010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.574097 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.574167 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.593419 (+ 19252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.594531 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.599797 (+ 5266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:57.600545 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:57.600661 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:57.619411 (+ 18750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 22:59:57.619420 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 22:59:57.619425 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 22:59:57.619477 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 22:59:57.623452 (+ 3975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.648976 (+ 25524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.648983 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.648986 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.649199 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 22:59:57.662540 (+ 13341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 22:59:57.662550 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 22:59:57.662554 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 22:59:57.663097 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 22:59:57.663420 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:57.676951 (+ 13531us) server_negotiation.cc:299] Negotiation successful
0805 22:59:57.677290 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 22:59:57.695371 22233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03d1faf30929450b8002a6da3617df11. Latest consensus state: current_term: 1 leader_uuid: "03d1faf30929450b8002a6da3617df11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.695767 22233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:57.701949 22304 mvcc.cc:205] Tried to move back new op lower bound from 7315336387161845760 to 7315336386703867904. Current Snapshot: MvccSnapshot[applied={T|T < 7315336387161845760}]
I20260805 22:59:57.707363 22280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03d1faf30929450b8002a6da3617df11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.707739 22280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:57.713172 22311 mvcc.cc:205] Tried to move back new op lower bound from 7315336387161845760 to 7315336386703867904. Current Snapshot: MvccSnapshot[applied={T|T < 7315336387161845760}]
I20260805 22:59:57.714370 22233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03d1faf30929450b8002a6da3617df11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.714654 22233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:57.717353 22290 catalog_manager.cc:1347] Generated new cluster ID: 1fbb22e51d71464fbe58a22fa4c0deca
I20260805 22:59:57.717487 22290 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 22:59:57.730845 22257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03d1faf30929450b8002a6da3617df11. Latest consensus state: current_term: 1 leader_uuid: "03d1faf30929450b8002a6da3617df11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.731209 22257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:57.732075 22290 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 22:59:57.734041 22290 catalog_manager.cc:1504] Loading token signing keys...
I20260805 22:59:57.733984 22283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03d1faf30929450b8002a6da3617df11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.734251 22283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11 [sys.catalog]: This master's current role is: LEADER
I20260805 22:59:57.748539 22257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03d1faf30929450b8002a6da3617df11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03d1faf30929450b8002a6da3617df11" member_type: VOTER last_known_addr { host: "127.20.34.126" port: 42471 } } peers { permanent_uuid: "2ef5a68acd954f329c17cb0e972c5896" member_type: VOTER last_known_addr { host: "127.20.34.125" port: 40269 } } peers { permanent_uuid: "4c60b6f3e65046b886bb11dbbf63c96b" member_type: VOTER last_known_addr { host: "127.20.34.124" port: 36829 } } }
I20260805 22:59:57.748930 22257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 22:59:57.756853 22312 mvcc.cc:205] Tried to move back new op lower bound from 7315336387161845760 to 7315336386703867904. Current Snapshot: MvccSnapshot[applied={T|T < 7315336387161845760}]
I20260805 22:59:57.782511 22290 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03d1faf30929450b8002a6da3617df11: Generated new TSK 0
I20260805 22:59:57.783663 22290 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 22:59:57.917608 22227 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:57.908119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54860 (local address 127.20.34.124:36829)
0805 22:59:57.908381 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.908390 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.914039 (+ 5649us) server_negotiation.cc:407] Connection header received
0805 22:59:57.915320 (+ 1281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.915330 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.915467 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.915565 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.917238 (+ 1673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54860: BlockingRecv error: recv got EOF from 127.0.0.1:54860 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
W20260805 22:59:57.920379 22228 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:57.908581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52180 (local address 127.20.34.126:42471)
0805 22:59:57.908875 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.908885 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.913516 (+ 4631us) server_negotiation.cc:407] Connection header received
0805 22:59:57.918164 (+ 4648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.918175 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.918308 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.918417 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.920009 (+ 1592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52180: BlockingRecv error: recv got EOF from 127.0.0.1:52180 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260805 22:59:57.923892 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:57.913723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39650 (local address 127.20.34.125:40269)
0805 22:59:57.913931 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.913939 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.921703 (+ 7764us) server_negotiation.cc:407] Connection header received
0805 22:59:57.922119 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.922128 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.922276 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.922370 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.923587 (+ 1217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39650: BlockingRecv error: recv got EOF from 127.0.0.1:39650 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260805 22:59:57.934609 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:57.929113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39664 (local address 127.20.34.125:40269)
0805 22:59:57.929302 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.929308 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.932778 (+ 3470us) server_negotiation.cc:407] Connection header received
0805 22:59:57.933007 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.933014 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.933176 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.933321 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.934282 (+ 961us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39664: BlockingRecv error: recv got EOF from 127.0.0.1:39664 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260805 22:59:57.941090 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:57.939414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39672 (local address 127.20.34.125:40269)
0805 22:59:57.939585 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.939591 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.939611 (+ 20us) server_negotiation.cc:407] Connection header received
0805 22:59:57.939684 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.939689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.939779 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.939901 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.940844 (+ 943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39672: BlockingRecv error: recv got EOF from 127.0.0.1:39672 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260805 22:59:57.954202 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:57.951655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39680 (local address 127.20.34.125:40269)
0805 22:59:57.951878 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.951886 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.952511 (+ 625us) server_negotiation.cc:407] Connection header received
0805 22:59:57.952744 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.952750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.952878 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.952989 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.953908 (+ 919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39680: BlockingRecv error: recv got EOF from 127.0.0.1:39680 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260805 22:59:57.969099 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:57.966475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39696 (local address 127.20.34.125:40269)
0805 22:59:57.966767 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.966775 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.967388 (+ 613us) server_negotiation.cc:407] Connection header received
0805 22:59:57.967625 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.967630 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.967751 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.967861 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.968854 (+ 993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39696: BlockingRecv error: recv got EOF from 127.0.0.1:39696 (error 108)
Metrics: {"server-negotiator.queue_time_us":139}
W20260805 22:59:57.988407 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:57.985878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39706 (local address 127.20.34.125:40269)
0805 22:59:57.986071 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:57.986078 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:57.986715 (+ 637us) server_negotiation.cc:407] Connection header received
0805 22:59:57.986906 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:57.986912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:57.987048 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:57.987184 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:57.988122 (+ 938us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39706: BlockingRecv error: recv got EOF from 127.0.0.1:39706 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260805 22:59:58.013142 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:58.010485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39708 (local address 127.20.34.125:40269)
0805 22:59:58.010715 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.010724 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.011298 (+ 574us) server_negotiation.cc:407] Connection header received
0805 22:59:58.011539 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.011547 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.011649 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.011762 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:58.012804 (+ 1042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39708: BlockingRecv error: recv got EOF from 127.0.0.1:39708 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260805 22:59:58.052064 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:58.049145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39722 (local address 127.20.34.125:40269)
0805 22:59:58.049410 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.049433 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.049925 (+ 492us) server_negotiation.cc:407] Connection header received
0805 22:59:58.050228 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.050236 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.050343 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.050468 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:58.051804 (+ 1336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39722: BlockingRecv error: recv got EOF from 127.0.0.1:39722 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
W20260805 22:59:58.122833 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:58.120642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39730 (local address 127.20.34.125:40269)
0805 22:59:58.120895 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.120902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.121224 (+ 322us) server_negotiation.cc:407] Connection header received
0805 22:59:58.121463 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.121467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.121544 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.121634 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:58.122599 (+ 965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39730: BlockingRecv error: recv got EOF from 127.0.0.1:39730 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
W20260805 22:59:58.257408 22120 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 22:59:58.255449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39740 (local address 127.20.34.125:40269)
0805 22:59:58.255708 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.255713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.256114 (+ 401us) server_negotiation.cc:407] Connection header received
0805 22:59:58.256320 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.256324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.256404 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.256503 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 22:59:58.257224 (+ 721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39740: BlockingRecv error: recv got EOF from 127.0.0.1:39740 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260805 22:59:58.303557 22251 catalog_manager.cc:1259] Loaded cluster ID: 1fbb22e51d71464fbe58a22fa4c0deca
I20260805 22:59:58.303709 22251 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: loading cluster ID for follower catalog manager: success
I20260805 22:59:58.306329 22251 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: acquiring CA information for follower catalog manager: success
I20260805 22:59:58.308213 22251 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4c60b6f3e65046b886bb11dbbf63c96b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:59:58.391857 22274 catalog_manager.cc:1259] Loaded cluster ID: 1fbb22e51d71464fbe58a22fa4c0deca
I20260805 22:59:58.392009 22274 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: loading cluster ID for follower catalog manager: success
I20260805 22:59:58.394694 22274 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: acquiring CA information for follower catalog manager: success
I20260805 22:59:58.396745 22274 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2ef5a68acd954f329c17cb0e972c5896: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 22:59:58.523487 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:58.517505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39744 (local address 127.20.34.125:40269)
0805 22:59:58.517766 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.517773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.518015 (+ 242us) server_negotiation.cc:407] Connection header received
0805 22:59:58.518277 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.518281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.518484 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.518625 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:58.519115 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.519814 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.521207 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.521616 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.521761 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:58.522293 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:58.522830 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:58.523008 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:58.523123 (+ 115us) server_negotiation.cc:299] Negotiation successful
0805 22:59:58.523208 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260805 22:59:58.536056 22417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:58.529826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54866 (local address 127.20.34.124:36829)
0805 22:59:58.530344 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.530351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.530530 (+ 179us) server_negotiation.cc:407] Connection header received
0805 22:59:58.530807 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.530811 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.530991 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.531183 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:58.531600 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.532403 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.533750 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.534140 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.534285 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:58.534805 (+ 520us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:58.535370 (+ 565us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:58.535544 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:58.535665 (+ 121us) server_negotiation.cc:299] Negotiation successful
0805 22:59:58.535752 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":274,"threads_started":1}
I20260805 22:59:58.551862 22426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:58.541990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.20.34.126:42471)
0805 22:59:58.545139 (+ 3149us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.545144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.545160 (+ 16us) server_negotiation.cc:407] Connection header received
0805 22:59:58.545263 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.545266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.545435 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.545581 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:58.546243 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.547242 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.549258 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.549729 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.549879 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:58.550537 (+ 658us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:58.550977 (+ 440us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:58.551082 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:58.551404 (+ 322us) server_negotiation.cc:299] Negotiation successful
0805 22:59:58.551535 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3039,"thread_start_us":2931,"threads_started":1}
I20260805 22:59:58.553110 22417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:58.542522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54874 (local address 127.20.34.124:36829)
0805 22:59:58.542690 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.542696 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.545911 (+ 3215us) server_negotiation.cc:407] Connection header received
0805 22:59:58.546215 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.546221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.546291 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.546404 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:58.547272 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.548465 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.550932 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.551566 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.551730 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:58.552274 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:58.552413 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:58.552474 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:58.552722 (+ 248us) server_negotiation.cc:299] Negotiation successful
0805 22:59:58.552817 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260805 22:59:58.553264 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 22:59:58.542825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39752 (local address 127.20.34.125:40269)
0805 22:59:58.543099 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0805 22:59:58.543107 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 22:59:58.546157 (+ 3050us) server_negotiation.cc:407] Connection header received
0805 22:59:58.546437 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 22:59:58.546444 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 22:59:58.546556 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 22:59:58.546656 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 22:59:58.547373 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.548104 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.550873 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 22:59:58.551553 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 22:59:58.551686 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 22:59:58.552493 (+ 807us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 22:59:58.552626 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 22:59:58.552708 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0805 22:59:58.552922 (+ 214us) server_negotiation.cc:299] Negotiation successful
0805 22:59:58.553003 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260805 22:59:58.557403 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 21906
I20260805 22:59:58.558494 22006 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:58.676954 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 21906
W20260805 22:59:58.705101 22048 connection.cc:535] server connection from 127.0.0.1:39622 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 22:59:58.705814 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22023
I20260805 22:59:58.707036 22107 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:58.822506 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 22023
I20260805 22:59:58.852514 20617 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu pid 22124
I20260805 22:59:58.853663 22216 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 22:59:58.966284 20617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskj1qIwm/build/asan/bin/kudu with pid 22124
2026-08-05T22:59:58Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5189 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10542 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (399306 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST